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Abstract 


The results of formative assessments are regularly used to infonn important instructional 
decisions (e.g., targeted intervention) within a response to intervention (RTI) system of 
teaching and learning. The validity of such instructional decision-making depends, in 
part, on the alignment between formative measures and the academic content standards 
on which classroom instruction is based, as well as the technical adequacy of the 
measures used in RTI applications. In the following technical report, we describe the 
development and scaling of the easyCBM Common Core State Standards elementary 
school mathematics measures for use within an RTI framework. Within a given grade, 
math items from two distinct item pools were calibrated to a common horizontal scale 
using a 1 -parameter Rasch analysis. The results of the scaling were then used to 
construct 13 alternate forms designed to be of comparable difficulty - 3 forms designated 
for seasonal benchmark screening and 10 designated for progress monitoring. Prior and 
subsequent grade-level math items were added to the benchmark test fonns as a basis for 
constructing a common vertical scale in the future. Evidence of technical adequacy is 
reported in appendices by both test form and by the full bank of CCSS items piloted and 


scaled 
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The Development and Scaling of the easyCBM CCSS 
Elementary Mathematics Measures: Grade 1 

The mathematics measures from the easyCBM interim-formative assessment system for 
grades K-8 were designed for use in a Response to Intervention (RTI) framework (Alonzo, Lai, 

& Tindal, 2009a, 2009b, 2009c; Alonzo & Tindal, 2009a, 2009b; Lai, Alonzo, & Tindal, 2009), 
which can be used both for whole-school improvement (Shores & Chester, 2009) as well as to 
identify students in need of special education services (VanDerHeyden, Witt, & Gilbertson, 
2007). A functional RTI system hinges on the use of measures that are aligned with adopted 
content standards, so that instructional decisions are based on results from student assessment 
that reflect what they are learning in their classrooms (Fuchs & Fuchs, 2006). The easyCBM 
measures were originally developed to align with the National Council of Teachers of 
Mathematics (NCTM) Focal Points Standards (Nese et al., 2010), that were adopted by many 
states as the basis for teaching mathematics. 

In 2010 the Common Core State Standards (CCSS) were released as a guide for preparing 
students for college and careers (National Governors Association Center for Best Practices & 
Council of Chief State School Officers, 2010). The subsequent endorsement of the standards by 
the U.S. Department of Education (2010) and their recommendation of creating assessments that 
provide improved measurement of student progress toward skills outlined in the CCSS, 
coincided with a majority of states adopting the CCSS as the basis for student instruction and 
assessment (National Governors Association Center for Best Practices & Council of Chief State 
School Officers, 2010). Similarly, developers of curriculum-based measurements (CBM), long 
used to monitor growth toward general outcomes and skill mastery through multiple short, 
technically adequate, and sufficiently equivalent test forms (e.g., Deno, 2003; Tindal, 2013), also 
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began work to align their measures with the CCSS. A study of existing easyCBM math 
measures to determine the extent to which they were in alignment with the CCSS followed in 
2012 (Irvin, Park, Alonzo, & Tindal, 2012a, 2012b; Park, Irvin, Alonzo, & Tindal, 2012). 

The 2012 alignment studies found reasonable alignment between the easyCBM 
mathematics measures and the CCSS for grades K-5; however, gaps across specific grade-level 
domains and standards remained. Identification of these gaps provided the basis for developing 
new technically adequate K-5 CCSS-aligned math items and test forms for use in the easyCBM 
interim-formative assessment system and in RTI application - the development, piloting and 
scaling of which are discussed in this technical report. 

Methods 

In developing the easyCBM CCSS mathematics measures, we focused on alignment with 
the CCSS and accessibility for diverse student populations with a range of achievement levels. 
The following section outlines the process we used to develop math items and subsequently 
assemble benchmarking and progress monitoring test forms for use in RTI frameworks of 
teaching and learning. 

Item Development 

The K-5 CCSS in mathematics are comprised of four (Grades 1 and 2) or five (Grades K, 
3-5) domains that are further divided into 21-28 individual standards. Though some grade- 
level standards were further divided into more granular sub-standards, such sub-standards were 
treated as part of the larger standard; thus, an item written to a given sub-standard was 
considered as being written to its parent standard. A total of 3,000 new CCSS math items were 
written, 500 items in each of grades K-5, based on the gaps in CCSS coverage identified through 
previous research (Irvin et ah, 2012b; Park et ah, 2012). 
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Item writing and review training. Two groups were recruited to develop CCSS math 
items based on their experience and expertise in mathematics teaching and learning. Four item 
writers for each of three grade bands: K-l, 2-3 and 4-5, and six item reviewers, one for each of 
grades K-5, were recruited. One of the original four item writers voluntarily dropped from the 
study, and thus, two item writers split their duties within the grade 4-5 band. Writers and 
reviewers were recruited to develop and review math items appropriate to their expertise. On 
average, item writers and reviewers had about 14 years of teaching experience in math education, 
ranging from 3-32 years. Each item writer/reviewer held a Bachelor’s degree and 16 of the 18 
(including all reviewers) also held a Master’s degree. Item writers were recruited in a manner to 
balance expertise across general and special education classrooms. All item reviewers had 
demonstrated expertise in both general and special education and also worked in district 
leadership positions, for example, as math coaches or curriculum developers. 

In December 2012, item writers and reviewers attended one of four mandatory 2.5-hour 
training webinars, led by the lead project researcher, who was onsite at the offices of Behavioral 
Research and Teaching (BRT) at the University of Oregon. The webinar training consisted of 
two main sections. An initial study overview reviewed the context of the research study and 
described item writing and reviewing duties in detail. Specifically, for each new CCSS math 
item, item writers and reviewers were required to write a stem (question or prompt) and three 
answer choices (one correct and two distractors) that were similar in length and complexity level. 
When constructing distractor options, writers and reviewers were informed that they should be 
relevant to the math skills required by the problem - ideally targeting a range of plausible student 
mistakes. Item writers and reviewers could also include graphics for the stem and/or answer 
options when relevant to the problem. When graphics were called for, item writers provided a 
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rough sketch and/or description of the graphic, and a graphic artist later created digital images 
for each of the graphics. The second training section focused on techniques around effective and 
appropriate item writing, and included principles of quality item/test development as outlined by 
Haladyna (2004) and Downing (2006a, 2006b), and those around Universal Design for 
Assessment (e.g., precise construct targets, accessibility to diverse populations, lack of bias) as 
outlined by Thompson, Johnstone, and Thurlow (2002). 

Throughout each section of the webinar training, item writers and reviewers were 
required to collaboratively participate in activities designed to ensure deep understanding of 
study roles, including observation and discussion of math items. In other words, a variety of 
math items were shown to writers and reviewers, followed by a discussion of why they met or 
did not meet the principles of quality item/test development or why they were (or were not) 
aligned to the CCSS. The lead researcher, writer and reviewers brainstormed and discussed 
specific ways in which items could be altered to meet item design principles or better align to an 
identified CCSS in instances where non-examples were shown. Particular attention was paid to 
crafting effective distractor options and graphics options associated with math items. Effective 
multiple-choice items typically have one distractor option that is “closer” to the correct response 
and one distractor that is “further” from the correct response (Haladyna, 2004) - the third 
response option being the correct answer for a given math item. Graphics, whether for the stem 
and/or answer options, are included for a math item only as necessary to meet a targeted content 
standard and to critically consider and solve a given math problem. This was the manner in 
which writers were asked to write answer options and include graphics for this study. At the end 
of the training webinar, the item writing process was again described in detail, including the 
specific roles of item writers and reviewers, in connection with expected timelines and 
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deliverables. The PowerPoint Slides used in the webinar training were adapted from those used 
in Anderson, Irvin, Patarapichayatham, Alonzo, and Tindal (2012), and are shown in Appendix 
A. 

Item writing. In general, item writers and reviewers worked concurrently to write, edit 
and revise 500 new CCSS-aligned math items (four item sets) in each of grades K-5. 

Specifically, item writers wrote 250 new math items: 125 items (in each of two items sets) for 
each grade of their assigned grade band (i.e., K-l, 2-3 or 4-5). For example, “item writer 1” was 
assigned to write 125 math items in each of Grades K and 1 to align with the targeted CCSS. 
Table 1 displays the math item writing plan for first grade by item set and CCSS. Item writers 
iteratively wrote and submitted items to the lead researcher (and item reviewers) in small batches 
between January and March 2013, typically submitting between 10-25 items at a time for further 
review and editing. Throughout the iterative item writing process, item writers and reviewers 
were in contact with the lead researcher by email and phone to hone their skills, and thus, the 
quality and consistency of math items produced. 

Item review. We conducted three separate stages of item review prior to item scaling: 

(a) review by contracted item reviewers, (b) an internal review by University of Oregon 
education researchers at BRT, and (c) an external review by individuals without prior connection 
to the items. The first review took place concurrently with item writing, in which a single item 
reviewer was assigned to review all 500 math items for a given grade level (K-5). Prior to 
contracted item reviewers receiving items, the lead researcher briefly reviewed the small batches 
of submitted items for completeness, accuracy and features consistent with effective item writing 
discussed during the webinar training (e.g., effective items, Universal Design for Assessment), 
subsequently passing them to the assigned reviewer concurrent with the item writing process. 
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Item reviewers then carefully reviewed and edited each grade level math item for completeness, 
accuracy and features consistent with effective item writing discussed during the webinar 
training - this included editing for distractor and graphical option appropriateness. Further, 
because item reviewers had access to 125 items from each of four item writers, they also edited 
math items that were too similar (across item writers) while attempting to maintain the content 
and skill intention of the item writers. 

For the second stage of item review, all math items (subsequent to graphics development 
- see below) were uploaded to a secure website to be reviewed as students would see them in the 
online easyCBM formative assessment environment. Math items were then assigned and 
reviewed internally by a group of university education researchers from BRT. Reviewers 
included university faculty and doctoral students in education research with experience in test 
and item development. During the internal review, reviewers again analyzed and edited items 
for mathematical correctness while also looking for possible bias or features inconsistent with 
Universal Design for Assessment principles. Additionally, internal reviewers ensured that all 
items were formatted in a consistent manner. All reviewers during this stage had been trained 
and taken part in a previous internal review of middle school math items (Anderson et ah, 2012), 
and thus, were deemed competent to serve on the internal review team in the current study. A 
team of external reviewers without prior connection to the item development conducted the final 
item review. We contracted with three individuals who did not have item writing or mathematics 
teaching/assessment experience to review math items (on the secure website) for mathematical 
accuracy, consistent formatting, and audio file accuracy (see below). Our intention behind this 
manner of external review was to have a “fresh look” at the math items apart from the item 
writers, various reviewers and the lead researcher, all of whom had had considerable prior 
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contact with the math items. 

Graphics and audio development. We contracted with a professional graphics artist to 
produce images for all math items. The artist used Adobe Illustrator to develop simple and clear 
line drawings without shading consistent with Universal Design for Assessment 
recommendations (Thompson et ah, 2002). The artist produced graphics only when explicitly 
requested by the item writer/reviewer - a development option for the stem and/or the answer 
options for a given math item. The artist produced each item graphic based on either a detailed 
written description or a hand-drawn/electronic version (e.g., a jpeg found on the Internet) 
provided by an item writer/reviewer. Graphic images were iteratively edited based on feedback 
from the three review stages. We also contracted an individual to produce audio recordings of 
written text in all math items. In the easyCBM online assessment system, students have the 
option to click on a speaker button next to the stem and/or distractor answer, which results in 
having the text-based portions of the item “read-aloud” to them. Audio recordings were 
reviewed and revised as necessary during the second and third review stages during item 
development. 

Scaling 

We carried out four primary steps during the scaling of the new K-5 CCSS math items: 

(a) developing a piloting plan, (b) selecting anchor items from the existing NCTM-based 
easyCBM and the new CCSS math item pools to create pilot forms, (c) recruiting subjects and 
piloting the items, and (d) calibrating grade-level items to a common scale. 

Piloting plan. For each of grades K-5, we developed a common piloting plan, comprised 
of 15 total pilot forms, to guide pilot form creation. We included 32 total math items in each 
form for grade K-l, and 41 total items for grades 2-5. Of the 32 or 41 items in a given pilot 
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form, we dedicated 5 horizontal anchor items to link to the previous pilot form and 5 horizontal 
anchor items to link to the subsequent pilot form. For example, pilot form 2 had 5 anchor items 
linking to pilot form 1, and 5 anchor items linking to pilot form 3. This meant that there were 22 
unique math items in each of the grade-level pilot forms for grades K-l, and 3 1 for grades 2-5. 
Of the 10 total anchor items within a given pilot form, 5 were selected from the existing 
easyCBM item pool - items originally written to the NCTM Focal Point Standards (Nese et al., 
2010), though deemed aligned to the CCSS in recent alignment studies (Irvin et ah, 2012b; Park 
et ah, 2012), and 5 were selected from the new CCSS-based item pool. For simplicity and 
clarity, these two pools will hereto be referred to as NCTM and CCSS item pools, though it 
should be noted that all items used in this project from both pools had been deemed aligned to 
the CCSS (the full combined CCSS item bank). 

By including horizontal anchors from both item pools, we were able to more than double 
the size of the overall item pool from which we would select items to create the operational 
CCSS test forms by calibrating the two original pools to a common scale. Additionally, this 
saved valuable item writing and review resources. It should be noted that unlike the piloting 
plan used for the easyCBM CCSS middle school math measure development study (see 
Anderson et ah, 2012), vertical (across-grade) anchor items were not included in the K-5 
piloting. Rather, we included prior- and subsequent-grade math items in the operationalized test 
forms for grades 1-5 (and prior-grade items for grade K) in order to calibrate a common scale 
over the 2013-2014 academic year, reasoning far more students would provide item-level 
information for the operationalized items as a basis for future review of technical adequacy of 
items and test forms (see fonn creation, below). The K-2 piloting plan, showing the number and 
placement of horizontal anchor items selected from both the existing NCTM as well as the CCSS 
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item pools, is displayed in Table 2. 

Choosing anchors and creating pilot forms. A team of four researchers (including the 
lead researcher) collaborated to select the anchor items from the NCTM and CCSS pools for 
pilot forms. One of the researchers had a Ph.D. in Educational Measurement and Evaluation, 
and two were doctoral students in the University of Oregon’s Educational Methodology, Policy, 
and Leadership program. The researcher with the Ph.D. and both doctoral students were familiar 
with the math item development and items, as they had worked with the lead researcher during 
item writing and had served on the internal item review team. 

As mentioned earlier, anchor items for the current piloting were selected from two 
different item pools by four researchers. Items selected from the K-5 NCTM pool had been 
previously piloted and scaled (Alonzo et ah, 2009a, 2009b, 2009c; Alonzo & Tindal, 2009a, 
2009b; Lai et ah, 2009), and thus, item-level information was available to guide anchor selection. 
Researchers followed a number of guidelines when selecting anchor items from the NCTM pool. 
Anchor items were selected to balance estimated difficulty across all 1 5 pilot forms (easy, 
medium, hard), while also falling within the acceptable range of mean-square outfit values (0.5 
to 1 .5) recommended for reliable measurement in high-stakes multiple-choice test construction 
(Wright & Linacre, 1994). 

A further constraint for selection of anchor items from the NCTM pool was that they be 
aligned to the CCSS. Based on results from Irvin et al. (2012b) and Park et al. (2012), we cross- 
walked NCTM Focal Point Standards and CCSS that were associated with each other when 
NCTM-written items were deemed aligned to particular CCSS in the alignment studies. In this 
manner, items originally written to the NCTM Focal Point Standards, though not necessarily 
included in the 2012 alignment studies, were deemed aligned to the CCSS and included in the 
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pool from which we selected anchor items in the current study (in addition to those items 
specifically deemed aligned in the earlier studies). Lastly, we attempted to stratify anchor items 
selected from the NCTM pool by CCSS. For instance, in first grade there are 4 different CCSS 
domains with a total of 37 unique anchor items needed to populate the 15 pilot forms; thus, 9-10 
items were selected from each CCSS domain in first grade and stratified across pilot forms as 
evenly as possible. 

Empirically estimated item-level information was not available for items in the new 
CCSS pool; thus, it was impossible to know the difficulty or mean-square outfit of items in the 
K-5 CCSS pool to guide anchor selection. Therefore, we adopted the same anchor item selection 
process used in our previous easyCBM CCSS middle school math item development study (see 
Anderson et ah, 2012, p. 9 and 22), whereby our team of four researchers worked together to 
select appropriate anchor items for pilot forms based on: (a) an appropriate number of steps 
required to respond to the item (typically 2-3), (b) minimal language requirements outside of that 
needed to solve the math problem, (c) culturally unbiased (e.g., a blend of diverse names, 
avoiding overrepresentation of subject matter unrelated to the targeted math knowledge/skills), 
(d) direct alignment to targeted CCSS, and (e) consistency with principles of Universal Design 
for Assessment. As was the case for anchor items selected from the NCTM pool, those selected 
from the CCSS pool were stratified by CCSS domain in an attempt to balance representation 
within and across each grade-level pilot form. 

After we selected horizontal anchor items, we created 1 5 pilot forms for each of grades 
K-5. For all grades, the first 4 items of each pilot fonn were unique items written to the CCSS as 
part of this study. The next 10 items (items 5-14) of each form were horizontal anchor items. 

We populated items 5-9 with anchor items selected from the NCTM pool, and items 10-14 with 
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anchor items selected from the CCSS pool. For both bands of anchor items (5-9 and 10-14), 
either 2 or 3 items li nk ed to previous or the following pilot forms as shown in Table 2. It should 
be noted that pilot forms 1 and 1 5 shared either 2 or 3 horizontal anchor items between them, 
given they were at the “ends” of the line of forms (i.e., form 15 served as the “previous” form to 
form 1 and vice versa). In keeping with the recommendations of Kolen and Brennan (2004), the 
placement and order of each anchor item were held constant on a given pilot form. Finally, the 
unique items were last: items 15-32 for grades K-l, and 15-41 for grades 2-5. All unique items 
were stratified within and across pilot forms by standard and domain as appropriate and possible 
to balance content representation. 

Participant recruiting and participation. Over the winter and spring of 2013, teachers 
from K-5 classrooms were recruited to participate in the pilot individually and at the district level 
through the easyCBM (http://www.easycbm.com) and BRT websites (http://www.brtproiects.org 
/about /current-research), and through existing research cooperative relationships around the 
country. To protect confidentiality, districts, schools and teachers interested in participating 
were informed in writing that identifying information (e.g., demographics) would not be 
collected on students or teachers, and only information relevant to meeting research partnership 
status would be collected at the school and district levels (e.g., the total number of participating 
students per district or school). At the same time, interested participants were also given general 
details concerning the piloting process, described more specifically below, to make clear the 
study requirements. 

A minimum of 200 student responses per item is desirable to obtain stable and accurate 
item calibrations using the 1 -parameter logistic Rasch model in a concurrent equating design, as 
was used in the current study. To fulfill this minimum response requirement, we needed to 
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recruit 3000 students (15 forms * 200 responses) for each of grades K-5. We were, however, 
constrained by the end of the academic calendar and recruitment resources, and thus, we did not 
meet the minimum desirable response requirements for each form (and item). In total, 7,700 
students and 329 teachers from 140 schools, in 132 districts, across 33 states participated in the 
piloting portion of the study that began on May 15, 2013 and ended on June 15, 2013. The 
following number of students participated in the pilot by grade: 731 (grade K), 1,124 (grade 1), 
1,136 (grade 2), 1,685 (grade 3), 1,499 (grade 4) and 1,525 (grade 5). Final pilot participation 
statistics by grade and fonn are given in Table 3. 

Piloting process. Once they agreed to participate, teachers were given detailed 
instructions on how to access the secure piloting website, how to have their students select the 
appropriate grade level (K-5), and how their students would begin and take the online test. 
Students were instructed to use scrap paper as necessary, but not to use calculators to complete 
any math items. Once students selected their appropriate grade, they were shown a title screen 
that prompted them to begin the test by clicking an onscreen button when ready. Students were 
then immediately administered one of 15 grade-level pilot forms. The administered test form 
was automatically assigned by the piloting website, based on the number of students who had 
completed that form previously. In other words, students were assigned the grade-level pilot 
form with the fewest number of completions across all students in the pilot. Student responses 
(a, b, or c) were automatically recorded in a secure online database based on which response 
option a student selected, with the position in which the three answer options (a, b, or c) were 
displayed on the students’ computer screens randomized each time an item was administered. 
Given that pilot forms were assigned based on the number of times they had been completed and 
that answer options were randomly rotated each time an item was administered, cheating was a 
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limited concern. A screen capture of a first grade math item demonstrative of how all items 
displayed on the pilot website (and indeed the K-8 easyCBM formative assessment system) is 
shown in Figure 1. 




© 
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Figure 1. Screen capture of math item illustrating online display of math items in the pilot study 
and easyCBM assessment system. 

Item calibration. All math items, including those from the larger and previously- 
existing NCTM pool, were calibrated to the same scale using a 1-parameter logistic (1PL) Rasch 
model in a concurrent equating design using Winsteps 3.6.8 (Linacre, 2009). In the Rasch 
model, a special case of the 1 -parameter logistic model in which the item discrimination 
parameter is constrained to 1.0 and student ability is freely estimated (Linacre, 2008), all item 
and student parameters are estimated simultaneously from a single data file that contains all 
student responses, grades K-5. The concurrent equating design estimates student ability based 
on their responses to items, treating any non-responses as missing. Items are placed on the same 
scale through the inclusion of anchor items across grade level forms, displayed in Table 2. 
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The Rasch model is defined as 


P(X LS 


H e s ,pd = 


exp[(0 s -Pj)] 

1 +exp[(e s -Pi)] 


( 1 ) 


where: 

P = probability, 

Xts = the response of student s to math item i, 

6 S = the estimated ability of student s, and 

fit = the estimated difficulty of math item i (DeMars, 2010). 

We chose the more parsimonious 1PL Rasch model because it appears to fit these data 
well, and also because we had a large final item ba nk of CCSS math items (full CCSS item bank) 
for grades K-5, which we analyzed for functioning and used to construct the operational 
easyCBM test forms. In other words, we had a surplus of items from which to construct test 
forms, enabling us to eliminate those items that did not function well from the full CCSS item 
bank. 


Test form creation. Within each of grades K-5, we constructed 13 alternate test forms 
designed to be of comparable difficulty (3 to be used as seasonal benchmark screening tests and 
10 to be used as progress monitoring tests) to make up the CCSS Math portion of the easyCBM 
formative assessment system. All test forms consisted of items that appeared to function well, 
while counterbalancing CCSS domain representation within and across each grade level form as 
possible. To construct the test forms, we first eliminated all items from the full CCSS item ha nk 
that appeared to not fit the 1PL Rasch model with regard to estimated mean square outfit. 

Wright and Linacre (1994) simulated and analyzed hundreds of datasets, recommending that 
mean square outfit values between 0.5 and 1.5 could be interpreted as productive for 
measurement purposes for multiple-choice test construction, with values >2.0 considered 
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degrading to the measurement system. As an initial step in test form construction, we thus 
eliminated any item from contention that had mean square outfit smaller than 0.49 or greater than 
1.49. 

After eliminating such items, within each grade we sorted the remaining items in 
ascending order by the associated CCSS domain and the estimated difficulty of items (easiest to 
most difficult). Within each grade, there were either 4 (grades 1 and 2) or 5 (grades K, 3-5) 
CCSS domains we attempted to counterbalance within and across test forms. Thus, we 
attempted to select the same number of items from each CCSS domain across the 13 test forms at 
a given grade level, though this was not possible in all instances, as some CCSS domains were 
underrepresented relative to others. To accomplish counterbalancing CCSS domain 
representation while maintaining form comparability, we selected sets of 13 items of roughly 
comparable difficulty. We sought a range of difficulty between these selected item sets, 
including items with “reach” into the easier end of the difficulty spectrum, being cognizant that 
the operational tests would be used to assess diverse student populations, from both the special 
education and general education populations, within an RTI framework. In terms of the layout 
of selected math items within test forms, we clustered items within CCSS domain, and then 
ordered them from easiest to most difficult. We reasoned that construct-irrelevant variance 
would likely be lessened if students were jumping between domains less often, and if the math 
skill requirements of problems “ramped up” from lower- to higher-order within each domain. 

The final step in the test fonn creation process was our selection of horizontal anchor 
items between grade level seasonal benchmarks to allow for within-year growth estimation, and 
vertical anchors between seasonal benchmarks across grades as a basis for constructing a 
developmental scale score after the 2013-2014 academic year. The same team of four 
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researchers who selected anchors during piloting, selected anchor items for the operational test 
forms using the same process and guidelines previously described because they were intimately 
familiar with the math items and the item/test development process. 

We selected horizontal anchor items for each benchmark using a within- grade linking 
design. Within each grade, 5 horizontal anchors were selected to link the fall and winter 
benchmarks, and 5 to link the winter and spring; thus, each fall and spring benchmark test form 
had 5 horizontal anchor items, while the winter test had 10. Horizontal anchor items were 
selected from those items already making up the benchmark tests at that point in the test form 
creation process. At this point, we had constructed 13 test forms designed to be of comparable 
difficulty in each of grades K-5, each test form consisting of 25 (grades K-2) or 30 (grades 3-5) 
math items. 

We then selected vertical anchor items from the constructed test forms, adding 5 (grade 
K) or 10 (grades 1-5) math items to the end of each benchmark test in a manner that li nk ed 
adjacent grade level benchmarks of the same season. For example, we selected 5 first grade 
math items from the fall benchmark to add on to the end of the fall Kindergarten benchmark 
(linking fall grade K to fall grade 1). When a grade was adjacent to two other grades (i.e., grade 
3 is adjacent to both grades 2 and 4), additional vertical anchors were appended to the end of the 
seasonal benchmark test forms. For example, the third grade fall benchmark included 5 vertical 
anchor items from the second grade fall benchmark and 5 items from the fourth grade fall 
benchmark. Within each test form, adjacent grade-level vertical anchor items were ordered from 
easiest to most difficult based on the estimated difficulty of each item - the same manner in 
which unique and horizontal anchor items were ordered with respect to CCSS domain - and 
were appended to the end of each seasonal benchmark in the order of subsequent and then prior 
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grade, respectively. This pattern of vertical anchor linking prior and adjacent grades continued 
for all seasonal benchmarks for each of grades K-5 (and also grades 6-8, though those results are 
not included in this series of technical reports). Student responses to vertical anchor items over 
the 2013-2014 academic year will serve as the basis for constructing a cross-grade 
developmental scale as we move toward the reporting of a scale score in future years. 

Results 

As a result of item development and test creation efforts described in this study, we 
constructed 13 alternate test forms: 3 designated for seasonal benchmarking and 10 designated 
for progress monitoring, in each of grades K-5. We designed the test forms to be aligned with 
the CCSS in mathematics, to be of comparable difficulty within grade, and to be accessible for 
diverse student populations with a wide range of achievement. We loaded K-5 tests into the 
easyCBM database for use as online formative CCSS math assessments and released them for 
use in fall 2013. 

The results of our analyses are reported separately by grade (K-5), each in its own 
technical report. For first grade, each seasonal benchmark consists of 35 total math items, 
including 5 vertical anchor items linked to each of the respective grade K and grade 2 
benchmarks. Each progress-monitoring test form consists of 25 unique math items. The item 
difficulties for each of the 13 first grade test forms are displayed in Table 4. 

Item Statistics 

We present the results of the 1PL Rasch analysis in ascending order by test form and for 
the full CCSS first grade item ha nk in Appendices B and D, respectively. When examining item 
information in these appendices, it is important to highlight two statistics critical to evaluating 
item functioning within the context of Rasch-based test development: the estimated difficulty and 
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indicator of discrimination. The difficulty parameter, in equation 1, represents the estimation 
of how difficult item i is relative to all other items in the analytic sample, with approximate 
possible values ranging from -3 (easiest items) to +3 (most difficult items) in the standardized 
scale - the same scale on which student ability ( 0 S ) is reported (DeMars, 2010). An estimated 
difficulty equal to 0 could then be interpreted as a student with average ability would have an 
equal probability of getting the answer correct as incorrect. Individual item difficulties are 
averaged across forms, representing an average difficulty of each test form as displayed in Table 
4, to evaluate fonn equivalence. The average difficulty across all 13 first grade test forms is 
-0.005 (range = -0.031 to 0.034), or slightly below average difficulty. The second statistic that 
warrants highlighting is the indicator of item discrimination. As noted earlier, the 1PL Rasch 
analysis constrains the discrimination parameter to 1.0 (DeMars, 2010; Linacre, 2008). Though 
discrimination statistics are included for each item in Appendices B and D, it is important to 
distinguish that this item statistic is not a true estimation of item discrimination, but rather an 
rough indicator of item discrimination, approximated during a post-hoc calculation by 
WINSTEPS (Linacre, 2008). Interpretation of discrimination values in 1PL Rasch analysis is the 
same as those freely estimated in, for example, a 2-parameter logistic model; though, caution is 
warranted given they are merely rough indicators in this study. Discrimination values >1.2 are 
considered very high (more productive for measurement purposes), while values < 0.5 are 
considered very low, when item difficulty and student ability are estimated in the standardized 
scale (DeMars, 2010), as is the case in our analysis. 

Distractor Analysis 

We present response option statistics in ascending order by test form and for the full 
CCSS first grade item ha nk in Appendices C and E, respectively. Interpretation of statistics 
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within these appendices is similar to item level interpretation, but is presented for each of the 
three response options. We coded the correct response option as A for all items, while the * 
represents missing data (those students included in the analytic sample who did not respond to 
the given item either by choice, if administered the pilot fonn containing the item, or simply 
because they were not administered that form). We analyzed distractors, seeking to retain well- 
functioning items in which students with the highest average estimated ability selected the 
correct answer choice, thus demonstrating the highest average person measure, while students 
with lower average estimated ability selected one of the remaining answer options. As described 
earlier, we attempted to write items with one near distractor and one far distractor. Items 
functioning well would thus demonstrate near distractors with average person measure values 
slightly below that of the correct response option and far distractors with lower average person 
measure values. 

Discussion 

As instruction in public schools across the United States moves in closer alignment with 
the CCSS, it is important for formative student assessment to also move in that direction given 
that the results of such assessment are regularly used to inform instructional decision-making 
within RTI contexts. To a growing degree, the validity of instructional decision-making in these 
contexts depends on both the alignment between adopted fonnative assessments and the CCSS 
and also the technical adequacy of such assessments. In this series of technical reports, we 
described the development and scaling of the easyCBM CCSS Math assessments for grades K-5, 
designed for use within an RTI framework of instruction and formative assessment in elementary 


classrooms. 
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Table 1 


First Grade Item Writing Plan by CCSS Standard 


CCSS Standard 

Item Set 1 

Item Set 2 

Item Set 3 

Item Set 4 

Existing 
BM Align 

Total 

G1 

10 

10 

10 

10 

4 

40 

G2 

10 

10 

10 

10 

5 

40 

G3 

12 

11 

11 

11 

1 

45 

MD1 

8 

8 

8 

8 

1 

32 

MD2 

8 

8 

8 

8 

0 

32 

MD3 

8 

8 

8 

8 

0 

32 

MD4 

7 

7 

7 

8 

3 

29 

NBT1 

0 

0 

0 

0 

7 

0 

NBT2 

1 

2 

1 

1 

5 

5 

NBT3 

10 

10 

10 

10 

2 

40 

NBT4 

0 

0 

0 

0 

6 

0 

NBT5 

10 

10 

10 

10 

0 

40 

NBT6 

10 

10 

10 

10 

0 

40 

OA1 

0 

0 

0 

0 

6 

0 

OA2 

6 

6 

7 

6 

4 

25 

OA3 

0 

0 

0 

0 

5 

0 

OA4 

6 

6 

6 

7 

1 

25 

OA5 

6 

7 

6 

6 

1 

25 

OA6 

0 

0 

0 

0 

5 

0 

OA7 

6 

6 

7 

6 

0 

25 

OA8 

7 

6 

6 

6 

3 

25 

Set Total 

125 

125 

125 

125 

59 

500 


Note. Item Sets 1-4 reflect items written to each CCSS standard based on results from our 
previous alignment study (Irvin et al., 2012b), reflected in Existing BM Align column. Total 
represents the number of math items written to a given CCSS standard in the current study. 


easyCBM CCSS First Grade Math Measure Development 


25 


Table 2 


Grades K-2 Piloting Plan 


Form 

Cl 

C2 

C3 

C4 

C5 

C6 

C7 

C8 

C9 

CIO 

Cll 

C12 

C13 

C14 

C15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

22 

32 

2 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

3 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

4 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

5 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

6 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

7 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

8 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

9 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

3 

22 

32 

10 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

2 

22 

32 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

3 

22 

32 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

2 

22 

32 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

3 

22 

32 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

2 

22 

32 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

0 

22 

32 


Form 

N1 

N2 

N3 

N4 

N5 

N6 

N7 

N8 

N9 

N10 

Nil 

N12 

N13 

N14 

N15 

Anchor 

Unique 

Total 

1 

5 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

5 

22 

32 

2 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

3 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

4 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

5 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

6 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

7 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

- 

- 

2 

22 

32 

8 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

- 

- 

3 

22 

32 

9 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

- 

- 

2 

22 

32 

10 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

- 

- 

3 

22 

32 

11 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

- 

- 

2 

22 

32 

12 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

- 

- 

3 

22 

32 

13 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

- 

- 

2 

22 

32 

14 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

2 

3 

- 

3 

22 

32 

15 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

- 

3 

2 

0 

22 

32 


Note. C = CCSS pool anchor item; N = NCTM pool anchor item. Anchor items appearing in a vertical column (both CCSS or 
NCTM) were shared between the specified forms. For example, fonn 3 and form 4 shared 3 anchor items from the CCSS pool (set 
C3) and 2 from the NCTM pool (set N3). 
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Table 3 


Grades K-5 Piloting Participation Statistics 



Grade K 



Grade 1 



Grade 2 


Form 

Completed 


Form 

Completed 


Form 

Completed 


1 

48 

55 

1 

77 

84 

1 

97 

110 

2 

48 

51 

2 

70 

79 

2 

72 

251 

3 

50 

57 

3 

78 

102 

3 

85 

96 

4 

49 

56 

4 

87 

114 

4 

69 

76 

5 

48 

52 

5 

70 

77 

5 

66 

78 

6 

48 

52 

6 

70 

85 

6 

66 

78 

7 

48 

52 

7 

73 

82 

7 

66 

73 

8 

50 

52 

8 

72 

93 

8 

70 

80 

9 

50 

55 

9 

76 

85 

9 

89 

95 

10 

48 

51 

10 

73 

86 

10 

79 

88 

11 

52 

81 

11 

73 

87 

11 

75 

85 

12 

48 

54 

12 

86 

89 

12 

80 

104 

13 

47 

58 

13 

80 

99 

13 

69 

82 

14 

49 

70 

14 

70 

116 

14 

84 

85 

15 

48 

52 

15 

69 

77 

15 

69 

71 

Form Average 

49 

57 

Form Average 

75 

90 

Form Average 

76 

97 


Grade 3 



Grade 4 



Grade 5 


Form 

Completed 


Form 

Completed 


Form 

Completed 


1 

107 

250 

1 

104 

118 

1 

97 

135 

2 

107 

197 

2 

94 

112 

2 

110 

132 

3 

114 

128 

3 

89 

101 

3 

99 

123 

4 

118 

159 

4 

103 

115 

4 

95 

143 

5 

122 

139 

5 

119 

141 

5 

93 

102 

6 

114 

128 

6 

89 

95 

6 

99 

156 

7 

122 

146 

7 

91 

103 

7 

97 

110 

8 

110 

266 

8 

91 

111 

8 

118 

152 

9 

106 

115 

9 

104 

121 

9 

116 

133 

10 

106 

123 

10 

110 

118 

10 

103 

128 

11 

109 

116 

11 

89 

104 

11 

93 

113 

12 

119 

146 

12 

89 

118 

12 

100 

142 

13 

109 

170 

13 

103 

110 

13 

100 

121 

14 

116 

192 

14 

108 

232 

14 

111 

139 

15 

106 

136 

15 

116 

138 

15 

94 

105 

Form Average 

112 

161 

Form Average 

100 

122 

Form Average 

102 

129 


Note. Many test forms were started though not completed, thus, the number of student responses per item varies within form, as shown in Appendices B and D. 
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Table 4 


First Grade Item Difficulties by Test Form (without adjacent grade vertical anchor items) 


Item # 

PM1 

PM2 

PM3 

PM4 

PM5 

PM6 

PM7 

PM8 

PM9 

PM 10 

BMF 

BMW 

BMS 

Mean 

1 

-0.97 

-0.92 

-0.9 

-0.88 

-0.87 

-0.87 

-0.82 

-0.79 

-0.73 

-0.73 

-0.73 

-0.72 

-0.70 

-0.818 

2 

0.10 

0.07 

-0.04 

-0.04 

-0.05 

-0.06 

-0.08 

-0.09 

-0.14 

-0.15 

-0.15 

-0.20 

-0.23 

-0.082 

3 

1.31 

1.25 

1.76 

1.90 

1.25 

1.27 

1.49 

2.50 

1.85 

2.44 

1.69 

1.54 

1.74 

1.692 

4 

-2.26 

-2.52 

-2.26 

-2.48 

-2.29 

-2.47 

-2.31 

-2.42 

-2.32 

-2.41 

-2.33 

-2.33 

-2.35 

-2.365 

5 

-1.70 

-1.54 

-1.71 

-1.54 

-1.72 

-1.53 

-1.71 

-1.54 

-1.72 

-1.59 

-1.65 

-1.60 

-1.66 

-1.632 

6 

-1.00 

-0.95 

-0.95 

-1.00 

-0.94 

-0.94 

-0.98 

-1.00 

-0.94 

-0.95 

-0.95 

-0.95 

-0.96 

-0.962 

7 

-0.59 

-0.53 

-0.45 

-0.49 

-0.52 

-0.46 

-0.46 

-0.48 

-0.47 

-0.50 

-0.54 

-0.56 

-0.56 

-0.508 

8 

0.01 

0.04 

0.04 

0.05 

0.05 

0.06 

0.05 

0.08 

0.06 

0.09 

0.13 

0.09 

0.09 

0.065 

9 

0.91 

0.86 

0.89 

0.78 

0.84 

0.81 

0.71 

0.70 

0.76 

0.70 

0.93 

0.92 

0.92 

0.825 

10 

1.74 

1.80 

1.85 

1.82 

1.78 

1.95 

1.92 

1.85 

1.94 

1.94 

1.72 

1.72 

1.67 

1.823 

11 

-0.50 

-0.50 

-0.48 

-0.45 

-0.44 

-0.43 

-0.40 

-0.40 

-0.38 

-0.38 

-0.56 

-0.56 

-0.53 

-0.462 

12 

-0.08 

-0.06 

-0.02 

-0.08 

-0.14 

-0.15 

-0.18 

-0.20 

-0.21 

-0.21 

-0.18 

-0.18 

-0.18 

-0.144 

13 

0.14 

0.15 

0.16 

0.16 

0.17 

0.17 

0.18 

0.20 

0.21 

0.26 

0.32 

0.26 

0.26 

0.203 

14 

0.71 

0.75 

0.76 

0.75 

0.72 

0.77 

0.78 

0.78 

0.78 

0.78 

0.71 

0.69 

0.69 

0.744 

15 

0.86 

0.88 

0.87 

0.92 

0.94 

0.95 

0.93 

0.88 

0.87 

0.87 

0.99 

0.99 

1.01 

0.920 

16 

1.21 

1.17 

1.15 

1.25 

1.22 

1.25 

1.25 

1.22 

1.22 

1.27 

1.19 

1.20 

1.19 

1.215 

17 

1.54 

1.58 

1.59 

1.63 

1.62 

1.68 

1.63 

1.61 

1.42 

1.41 

1.51 

1.45 

1.45 

1.548 

18 

-0.02 

-0.02 

-0.11 

-0.41 

-0.43 

-0.67 

-1.10 

-0.95 

-0.88 

-0.85 

-0.02 

0.59 

0.73 

-0.318 

19 

-1.62 

-1.62 

-1.62 

-1.64 

-1.64 

-1.68 

-1.71 

-1.72 

-1.74 

-1.74 

-1.55 

-1.58 

-1.60 

-1.651 

20 

-1.30 

-1.41 

-1.41 

-1.41 

-1.39 

-1.36 

-1.35 

-1.35 

-1.33 

-1.33 

-1.32 

-1.31 

-1.31 

-1.352 

21 

-0.74 

-0.73 

-0.73 

-0.73 

-0.72 

-0.71 

-0.69 

-0.67 

-0.66 

-0.66 

-0.74 

-0.74 

-0.74 

-0.712 

22 

-0.48 

-0.49 

-0.51 

-0.50 

-0.52 

-0.50 

-0.49 

-0.49 

-0.48 

-0.47 

-0.46 

-0.46 

-0.45 

-0.485 

23 

0.18 

0.18 

0.19 

0.18 

0.17 

0.17 

0.23 

0.16 

0.16 

0.22 

0.21 

0.21 

0.21 

0.190 

24 

0.82 

0.82 

0.82 

0.83 

0.85 

0.85 

0.85 

0.86 

0.86 

0.87 

0.81 

0.81 

0.81 

0.835 

25 

1.34 

1.31 

1.31 

1.30 

1.29 

1.29 

1.28 

1.27 

1.26 

1.26 

1.41 

1.37 

1.36 

1.312 

Mean 

-0.016 

-0.017 

0.008 

-0.003 

-0.031 

-0.024 

-0.039 

0.000 

-0.024 

0.006 

0.018 

0.026 

0.034 

-0.005 


Note. PM1 to PM10 = Progress Monitoring Form 1 to Form 10; BMF = Benchmark Fall, BMW = Benchmark Winter, BMS = Benchmark Spring; Green = 
horizontal anchor items. 
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Appendix A: Training Materials 
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Common Core State Standards (CCSS) 
Math Item Writing and Review 

Supplementing the easyCBM math 
assessment system 


easyCBM 

• easyCBM is an online benchmark and progress 
monitoring assessment system. 

• Designed to inform teachers' classroom-based 
instructional decisions 

• Used within Response to Intervention (RTI) 
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easyCBM in Use 

• What are your experiences with easyCBM? 

Popularity of the System 

• Registered users in all 50 states 

• Over 2 million students in the system 

• Over 800,000 teachers in the system 

• Growing exponentially 

• Over 9000 new registered teacher users every 
month; with district-level subscribers growing 


Within RTI (very general) 



Standards, instruction and assessment must align 
for accurate decision-making and inferences! 
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Item 


Before we get too far: 
Vocabulary 


(Question) 

Stem 



Project Overview 

• Develop 3,000 new math items for easyCBM 
in grades K-5; 500 items per grade 

- Aligned with the Common Core State Standards 
(CCSS) 

- Piloted in April/May to examine their technical 
adequacy and establish difficulty 

— Developed items will be assembled with existing 
items that were aligned to CCSS into 20 test forms 
per grade (60 forms total). 

- Each form will have 25 items for use in easyCBM 

- Anticipated release date of Fall 2013 
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Existing Items vs. Items to be Developed 

Existing Items 

Items to be Developed 

• Originally developed for the 

• Should be developed for 

2% population (i.e., 

students performing at or 

students performing well 

slightly below grade-level 

below grade-level 

expectations. 

expectations) 

• Aligned to the NCTM Focal 
Point Standards 

• Aligned to the CCSS 


Common Core Standards (see PDF) 

Grade K 

Standard Domains 

• Counting and Cardinality (KCC) 

• Operations and Algebraic Thinking (KOA) 

• Number and Operations in Base Ten (KNBT) 

• Measurement and Data (KMD) 

• Geometry (KG) 

24 standards divided among 5 domains. 
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Outline of GrK Items to be Written/Reviewed 



Item Set 2 

Item Set 3 

Item Set 4 

Item Set 5 

CCSS B M Alien 

Total 

CCl 

5 

5 

6 

6 

0 

22 

CC2 

1 

1 

1 

1 

6 

4 

CC3 

6 

6 

5 

5 

1 

22 

CC4 

1 

1 

1 

1 

5 

4 

CCS 

5 

5 

6 

6 

3 

22 

CC6 

1 

1 

1 

1 

5 

4 

CC7 

6 

6 

5 

5 

2 

22 

SI 

1 

1 

1 

1 

6 

4 

G2 

1 

1 

1 

1 

7 

4 

S3 

10 

10 

11 

11 

2 

42 

G4 

1 

1 

1 

1 

5 

4 

G5 

11 

11 

10 

10 

0 

42 

G6 

1 

1 

1 

1 

8 

4 

MD1 

4 

4 

4 

4 

5 

16 

MD2 

2 

2 

2 

2 

9 

8 

MD3 

19 

19 

19 

19 

4 

76 

NBT1 

25 

25 

25 

25 

1 

100 

DAI 

5 

5 

5 

5 

3 

20 

DA2 

5 

5 

5 

5 

3 

20 

0A3 

5 

5 

5 

5 

0 

20 

OA4 

5 

5 

5 

5 

1 

20 

OA5 

5 

5 

5 

5 

3 

20 

Set Total 

125 

125 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 1 

Standard Domains 

• Operations and Algebraic Thinking (10A) 

• Number and Operations in Base Ten (1NBT) 

• Measurement and Data (1MD) 

• Geometry (1G) 


21 standards divided among 4 domains. 
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Outline of Grl Items to be Written/Reviewed 



hem Set 2 

hem Set 3 

hem Set 4 

hem Set 5 

CCSS B M Alien 

Total 

61 

10 

10 

10 

10 

4 

40 

62 

10 

10 

10 

10 



63 

12 

11 

11 

11 

1 

45 

MD1 

8 

8 

8 

8 

1 

32 

MD2 

8 

8 

8 

8 

0 

32 

MD3 

8 

8 

8 

8 

0 

32 

MM 

7 

7 

7 

8 

3 

29 








NBT2 

1 

2 

1 

1 

5 

5 

NBT3 

10 

10 

10 

10 

2 

40 








NBT3 

10 

10 

10 

10 

0 

40 

NBT6 

10 

10 

10 

10 

0 

40 








OA2 

6 

6 

7 

6 

4 

25 








044 

6 

6 

6 

7 

1 

25 

0A3 

6 

7 

6 

6 

1 

25 








0A7 

6 

6 

7 

6 

0 

25 

0A8 

7 

6 

6 

6 

3 

25 

Set Total 

125 

125 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 2 

Standard Domains 

• Operations and Algebraic Thinking (20A) 

• Number and Operations in Base Ten (2NBT) 

• Measurement and Data (2MD) 

• Geometry (2G) 


26 standards divided among 4 domains. 
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Outline of Gr2 Items to be Written/Reviewed 






hem Set 2 

Item Set 3 

Hem Set 4 

hem Set 5 

CCSS BM Alien 

Total 


si 

10 

10 

11 

11 

0 

42 

G2 

10 

11 

10 

10 

3 

41 

S3 

11 

11 

10 

10 

0 

42 








MD2 

3 

3 

3 

3 

3 

12 

MD3 

4 

3 

4 

4 

0 

15 

MD4 

3 

4 

4 

4 

0 

15 

WD5 

4 

4 

4 

3 

0 

15 

MD6 

3 

3 

3 

4 

2 

13 

>4 07 

3 

3 

3 

3 

3 

12 

MD8 

4 

3 

3 

3 

2 

13 

MD9 

3 

4 

4 

4 

0 

15 

MD10 

4 

4 

4 

3 

0 

15 








NBT2 

5 

5 

5 

5 

0 

20 

•4BT3 

5 

5 

5 

5 

0 

20 








NBT5 

1 

1 

1 

2 

5 

5 

NBT6 

5 

5 

5 

5 

0 

20 

NBT7 

5 

5 

5 

5 

2 

20 

NBT8 

5 

5 

5 

5 

2 

20 

NBT9 

5 

5 

5 

5 

0 

20 

OA1 

2 

1 

1 

1 

7 

5 

QA2 

10 

10 

10 

10 

3 

40 

OA3 

10 

10 

10 

10 

0 

40 

OA4 

10 

10 

10 

10 

1 

40 


125 

125 

125 

125 


500 





Common Core Standards (see PDF) 

Grade 3 

Standard Domains 

• Operations and Algebraic Thinking (30A) 

• Number and Operations in Base Ten (3NBT) 

• Number and Operations-Fractions (3NF) 

• Measurement and Data (3MD) 

• Geometry (3G) 

25 standards divided among 5 domains. 
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Outline of Gr3 Items to be Written/Reviewed 



Item Set 2 

Item Set 3 

Item Set 4 

Item Set 5 

CCSS BM Alien 

Total 

OAl 

5 

5 

5 

5 

3 

20 















OA4 

5 

5 

5 

5 

4 

20 

OA5 

5 

5 

5 

5 

2 

20 

OA6 

5 

5 

5 

5 

3 

20 








OA8 

5 

5 

5 

5 

3 

20 








NBT1 

8 

9 

9 

8 

0 

34 

NBT2 

9 

8 

8 

8 

0 

33 

NBT3 

8 

8 

8 

9 

1 

33 








NF2 

20 

20 

20 

20 

1 

SO 

NF3 

5 

5 

5 

5 

5 

20 

MD1 

3 

3 

3 

4 

0 

13 

MD2 

4 

3 

3 

3 

0 

13 

MD3 

3 

3 

4 

3 

0 

13 

MD4 

3 

4 

3 

3 

0 

13 

MD5 

3 

3 

3 

3 

0 

12 

MD6 

3 

3 

3 

3 

1 

12 

MD7 

3 

3 

3 

3 

0 

12 

MDfi 

3 

3 

3 

3 

1 

12 

G1 

20 

20 

20 

20 

4 

SO 

62 

5 

5 

5 

5 

15 

20 


125 

125 

125 

125 


500 


Common Core Standards (see PDF) 

Grade 4 

Standard Domains 

• Operations and Algebraic Thinking (40A) 

• Number and Operations in Base Ten (4NBT) 

• Number and Operations-Fractions (4NF) 

• Measurement and Data (4MD) 

• Geometry (4G) 

28 standards divided among 5 domains. 
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Outline of Gr4 Items to be Written/Reviewed 



Common Core Standards (see PDF) 

Grade 5 

Standard Domains 

• Operations and Algebraic Thinking (50A) 

• Number and Operations in Base Ten (5NBT) 

• Number and Operations-Fractions (5NF) 

• Measurement and Data (5MD) 

• Geometry (5G) 

26 standards divided among 5 domains. 
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Outline of Gr5 Items to be Written/Reviewed 



Item Set 2 

Hem Set 3 

Hem Set 4 

Item Set 5 

CCSS BM Alien 

Total 

OAl 

9 

9 

8 

8 

1 

34 

OA2 

8 

8 

8 

9 

0 

33 

0A3 

8 

8 

9 

8 

0 

33 

NBT1 

3 

4 

4 

4 

2 

15 

NBT2 

4 

4 

4 

3 

2 

15 

NBT3 

5 

5 

5 

5 

0 

20 

NBT4 

4 

3 

4 

4 

2 

15 

NBT5 

5 

5 

5 

5 

0 

20 

NBT6 

4 

4 

3 

4 

3 

15 















NF2 

3 

4 

4 

4 

2 

15 

NF3 

5 

5 

5 

5 

0 

20 

NF4 

4 

4 

4 

3 

1 

15 

KF5 

S 

5 

5 

5 

0 

20 

f»F6 

4 

4 

3 

4 

1 

15 

NF7 

4 

3 

4 

4 

2 

15 

MD1 

7 

7 

8 

8 

0 

30 

M02 

8 

8 

7 

7 

0 

30 








M04 

5 

5 

5 

5 

3 

20 

M05 

S 

5 

5 

5 

4 

20 

G1 

7 

6 

6 

6 

0 

25 

G2 

6 

6 

6 

7 

0 

25 

G3 

6 

6 

7 

6 

0 

25 

G4 

6 

7 

6 

6 

0 

25 


125 

125 

125 

125 


500 


Why So Many New Items? 

1. No matter how perfect an item looks, there 
are always quirks. 

- We need 250-300 "good" items per grade. 

- If we write 500 items per grade, we can "weed 
out" the poor items. 

2. The surplus of items also allows us to 
assemble items into test forms (i.e., seasonal 
benchmarks and progress-monitoring) of 
comparable difficulty. 
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Purpose 1 

Example: Two Similar Items 

Item 1 Item 2 


A. 

6 

15 

A. 4 

B. 

8 

p 

B * 18 

C. 

JL 

r, 

C. 1 


Purpose 1 

Example (continued) 

• Although the previous two items look very 
similar, our statistical analyses of the items 
functioning indicate that Item 1 is functioning 
quite well, while Item 2 is functioning quite 
poorly. 

• Item 2 was determined to be functioning poorly 
enough that it was removed 

• Despite the similarities in item construction, the 
students' responses to the items are very 
different (i.e., matching student ability w/ 
question difficulty). 
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Purpose 1 
Recap 

Item 1 Item 2 


i*i = _ 


a. -Hr a- 7 

b. { Good Item B -w Poor Item 

Why? It's difficult to say for sure, but is part of why we need to write a 
surplus of items 


Purpose 2 
RTI 

• RTI requires multiple test forms of equivalent 
difficulty 

• If forms are not equivalently difficult, 
assumptions about the growth students make 
and/or the effectiveness of instruction or an 
intervention may not be accurate 
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Purpose 2 
(Continued) 

• Growth? 

- What if first three 
forms were unusually 
difficult and the last 
two forms were 
unusually easy? 

• We need to have a sufficient number of items 
to ensure that forms actually are, statistically 
speaking, equivalently difficult. 


G*«d« 1. Wo id H« ini| FluMicy: Jufa Aton?® 



(•M Grea* 

£ ifl 

.u,_ • 

• 

sa - 




/ / s 

D«ta of AnainiliHtM 

Or»il 30 nvuimr on awcutor 


10PB • '30PB SOpb 90p* 


Your Role As the Item Writer and 
Item Reviewer 

A Concurrent Process of Item 
Writing , Reviewing , and Submission 
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Your role as the Item Writer 

• Become an "item writing expert" 

- Thoroughly review the CCSS associated with the 
grade-band you have been assigned (i.e., K-l, 2-3, 
and 4-5). 

- Review "example items" in ItemSet spreadsheet. 

• Complete two ItemSet spreadsheets, 
consisting of 125 items for each grade of your 
assigned grade band (i.e., 125 grade K items, 
and 125 grade 1 items for K-l grade band) 

• Thoroughly review all items written before 
turning items in to BRT (in batches). 


Your role as the Item Reviewer 

• Become an "item writing expert" 

- Thoroughly review the CCSS associated with the 
grade that you have been assigned (i.e., K, 1, 2, 3, 
4, or 5). 

- Review "example items" in ItemSet spreadsheet. 

• Review and edit 500 grade-level items from 
the 4 ItemSets (in batches). 

• Thoroughly review all items written before 
turning items in to BRT (in batches, by 
ItemSet). 
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Excel ItemSet Template cont. 

• Each ItemSet consists of 125 items 

• Item Writers will write all 125 items and fill out the 
excel sheet. 

- After writing items into the excel file, the Item Writer 
should add an underscore and their initials after the 
version number to save it 

• e.g., Item Writer = Shawn Irvin: 

G2ltemSet2.xlsx G2ltemSet2_Sl.xlsx 

• Each Item Writer will write items to specific CCSS, 
most times multiple items per standard 

• The number of items per domain will vary by Item 
Writer and grade. 


Excel ItemSet Template 


•rtnv ■■«!* f"* (Mfr i* r*«i i* id'r ?frtr 


.. Kli-iv 1 IhiKi" Hhtn 1 MMn Mlfim' ***.*?, V !! 


emt •»«» j wtn»r o. 


Sir- 


Write one Question (stem) and three 

Answer options in these cells 

• Option A is always the correct 
answer 

• Options B and C are always 
incorrect, but plausible distractor 
responses 


The "home" for all of the items we write and review!!! 
These ItemSet spreadsheets will be passed from Writers to 
me to Reviewers and back to me for an in-house review. 
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Item ID Naming Convention 

• It is crucial that all items written are filled out 
in the excel sheet appropriately 

• Graphics accompanying an item MUST BE 
given the same ID because the graphic is part 
of the item. 

- If the wrong ID is assigned to the graphic, it will 
either be lost or accompany the wrong item. 
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Graphics (images) in Items 

• First rule of graphics - they are expensive 

- Adds, on average, around $50 to the total cost of the 
item 

• Does this mean graphics should not be used? 

- No, but it does mean that graphics should only be used if 
they (a) increase the clarity of the item or (b) are 
essential to the content of the item (i.e., in geometry) 

- Graphics may be necessary for some standards! 

• There is also no clear research on the effect of 
adding a graphic to an item (Kettler, Elliott, & 
Beddow, 2009) 


Graphics in Items (cont.) 

• Graphics can be in question/stem, and/or in 
answer options! 

• If you as an Item Writer or Reviewer want to 
add graphics, they have two options: 

1. Describe what the graphic will look like in detail in 
the excel sheet (recommended if the graphic is 
simplistic). 

2. Draw the graphic by hand or use clipart from the 
web in the "Graphics Template" provided. 
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Describe what the graphic will look like in 
detail in the excel sheet (recommended if the 
graphic is simplistic). 




— ■ - . . lA) *tf *»- ntn+mr ... ■ - 

tW«Ttax >«»•••«■< *i If**. 

OptfNl ‘V^inJTTr^ 


M!> M • 

«rt«i 




!C< i 

•sort* '*■'» 

wmmiMa mo « i 

huMirainN 1 r.rM « J • rM nMii ll 

OtOO 

CU**» 




hnrlii r< >»*t 

, !»■ I* i»— » W »»■ 

nUH 





Protocol for Hand Drawn Graphics 


• Draw the graphic by hand using "Graphic Template" 

• Matching Item ID exactly! 


jgmeir^ l tyl \y- 




J U 


llom_ 3 Of 5 & P"9 


© isms El 
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Protocol for Hand Drawn Graphics 
(as it is seen in easyCBM) 



The head is a 


A. wangle 

B. circle 

C. square 


Protocol for Hand Drawn Graphics 

• Use clipart from the web and enter into "Graphics 
Template" 

http://www.fotosearch.com/ 



Note. We will not use any of the clipart in the actual items, 
but it is a way to communicate approximately what the 
graphic should look like. 
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easyCBM CCSS First Grade Math Measure Development 


49 

Appendix A: Training 


Use Basic Codes in ItemSet Spreadsheets 

(see ExampleSheet K-5CCSS.docx for more) 

• Image: [img]item_7NS3008.png[/img] 

• Division symbol: Bt 4 = 3[divide]4 = 3[div]4 

• Long division: 3[longdiv]42[/longdiv] 

• Square roots: V25 = [squareroot]25[/ 
squareroot] 

• Pi: Jt = [pi] 

• Vertically stacked add/sub/multiply: 

[plus]30:40:12[/plus] 30 

40 
+ 12 


Excel Sheet (see Example Problems) 
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The Basic Process 

Item Writers: 

• You will write and turn items in batches, 
approximately ~20-40 items at a time, and email 
them to me for a quick check for completeness 
and quality, with all 250 items, two completed 
ItemSet spreadsheets due by Friday, January 11 th , 
2013. 

• I will email OKd items to Item Reviewers. 

• Item Reviewers will individually be reviewing, 
editing aj[ items for ways to improve them, and 
returning them to me, but they should be a 
strong as you can get them before emailing them 
to me. 


The Basic Process (cont.) 

Item Reviewers: 

• After you have reviewed/edited all items in an 
item set and deemed them to be (a) aligned to 
the standard, (b) mathematically accurate, (c) 
grade-level appropriate, (d) free of bias, and (e) 
"good" overall items, you turn in the ItemSet 
spreadsheet to me at BRT. 

• Email items back to me in batches, a full ItemSet 
(i.e., 125 group of grade-level items from a single 
Item Writer) at a time -> you will turn in a total 
of four of these for your grade, with all ItemSets 
due by Friday, January 25 th , 2013 
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Deadlines and Compensation 

• Compensation will be released upon completion 
of your work, pending approval by BRT and the 
University of Oregon (me) 

• $800 for Item Writers completing two ItemSets 
of 125 items each, 250 total -> January, 11 th , 
2013 

• $1500 for Item Reviewers for reviewing/editing 
500 grade-level math items -> January, 25 th , 
2013 


Study-related or 
Procedural 
QUESTIONS? 
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Some Basic Item Writing 
Guidelines 
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Why multiple 

choice items? 

“Selected-response items are the most appropriate item 

format for measuring cognitive achievement or ability, 

especially higher order cognitive achievement or cognitive 

abilities, such as problem solving, synthesis, and 

evaluation.” (Downing, 2006, p. 288) 

• Validity 

• Efficiency 

— Less chance of 

— Easy to administer 

construct irrelevant 

— Easy to produce 

variance in scores 

— Easy to score 

— Allow a given skill 

objectively (as 

to be assessed 

opposed to 
constructed 

multiple times 

response item 

(multiple items) 

types) 


How do you write a good item? 

Art or SCIENCE? (maybe a little of both) 


Answer Options : 

• Use only 3 options: 1 
correct response and 2 
distracters 

• Choose logical distracters 

• Avoid excess text or 
irrelevant features 


Assess Only Target Knowledge : 

• Targeting Math 

• Reduce language as much as 
possible 

• If the item is supposed to 
assess fractions, make sure it 
doesn't assess other factors, 
such as conversions or 
estimations. 

Be Sensitive of Bias Issues : 

• Keep in mind the population of 
students who will be taking the 
items 

• Consider ELL, SWD, diverse 
cultures, etc. 
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Universal Design 

How should we design a building so the widest range 
of populations possible can access it? 



Universal Design for Assessment 


• Considers all characteristics of test-takers. 

• Precisely defined constructs. 

• Accessible, non-biased items. 

•" Items amendable foaccommodanonsl j 

• Simple, clear, and intuitive instructions and j 

procedures. I 


Maximum readability and comprehensibility. 

Maximum legibility of text, tables, figures, and 
illustrations 


Thompson, Johnstone, and Thurlow (2002) 
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TABLE 1 

A Revised Taxonomy of Multiple-Choice (MC) hem- Writing Guidelines 


Content concerns 

1. Every item should reflect specific content and a single specific menial behavior, as called for in 
test specifications (two-way grid, test blueprint). 

2. Base each item on important content to learn: avoid trivial conlenL 

3. Use novel material to test higher level learning. Paraphrase textbook language or language used 
during instruction when used in a test item to avoid testing for simply recall. 

4. Keep the content of each item independent from content of other items on the tesL 

5. Avoid over specific and over general content when writing MC items. 

6. Avoid opinion-based items. 

7. Avoid trick items. 

8. Keep vocabulary simple for the group of students being tested. 

Formatting concerns 

9. Use the question, completion, and best answer versions of the conventional MC, the alternate 
choice, true-false (TF). multiple true-false (MTF). matching, and the context-dependent item 
and item set formats, but AVOID the complex MC (Type K) format. 

10. Format the item vertically instead of horizontally. 

Style concerns 

1 1. Edit and proof items. 

12. Use correct grammar, punctuation, capitalization, and spelling. 

13. Minimize the amount of reading in each item. 

Writing the stem 

14. Ensure that the directions in the stem are very clear. 

15. Include the central idea in the stem instead of the choices. 

16. Avoid window dressing (excessive verbiage). 

17. Word the stem positively, avoid negatives such as NOT or EXCEPT. If negative words are used, 
use the word cautiously and always ensure that the word appears capitalized and boldface. 


TABLE 1 

A Revised Taxonomy of Multiple-Choice (MC) Hem-Writing Guidelines 


Writing the choices 

18. Develop as many effective choices as you can. but research suggests three is adequate. 

19. Make sure that only one of these choices is the right answer. 

20. Vary the location of the right answer according to the number of choices. 

21 . Place choices in logical or numerical order. 

22. Keep choices independent: choices should not be overlapping. 

23. Keep choices homogeneous in content and grammatical structure. 

24. Keep the length of choices about equal. 

25. None-of-lhe-uboxe should be used carefully. 

26. Avoid All-of-the -above. 

27. Phrase choices positively: avoid negatives such as NOT. 

28. Avoid giving clues to the right answer, such as 

a. Specific determiners including always, never, completely, and absolutely. 

b. Clang associations, choices identical to or resembling words in the stem. 

c. Grammatical inconsistencies that cue the test-taker to the correct choice. 

d. Conspicuous correct choice. 

e. Pairs or triplets of options that clue the test-taker to the correct choice. 

f. Blatantly absurd, ridiculous options. 

29. Make all distractors plausible. 

30. Use typical errors of students to write your distractors. 

31. Use humor if it is compatible with the teacher and the learning environment. 


Haladyna, 2002, p. 312 
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Content Concerns 

“Every item should reflect specific content and a single 
specific cognitive process” (Haladyna, 2004, p. 98). 

Guidelines 

• Write/review items that align with only one standard 
(or one part of one standard), and that the item 
targets that standard clearly and directly. 

— Target only one skill in each item. If standard asks for 
multiple skills, use multiple items. 

• Try not to be over-specific or over-general. 

• Try not to "trick the students" 

• Each item should be independent of all others. 

• Avoid focusing items on trivial parts of standards. 

• Present items in novel formats 

Note. The following slides are largely based on Haladyna, 2004. 


Targeting Only One Skill 

Standard 6.SP: Recognize that a measure of center for a numerical data set summarizes all of 
its values with a single number, while a measure of variation describes how its values vary with 

a single number. 


Example item 1 

Example item 2 

Which number 

Which number 

describes the center of 

describes the center of 

the dataset? 

the dataset? 

Dataset: 5, 7, 3, 3 

Dataset: 5, 7, 3, 3 

A) Average -4.50 

A) 4.50 

B) Standard deviation - 1.91 

B) 1.91 

C) Range -4.00 

C) 4.00 
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Targeting Only One Skill 

Example item 1 

Example item 2 

• The first item provides the 

• Second item requires 

student with the name of 

student to both know the 

the statistic AND the 

best statistic (average) AND 

number. 

to recognize which number 

• The target skill of the item 
(measure of central 

represents that statistic. 

tendency) is not confused 

• Item has less text, but in 

with other math skills. 

this case, the text may help 

HOWEVER - 
• Item still requires 

vocabulary and additional 
reading skills over a simpler 
version 

target the skill of interest. 


Targeting Only One Skill 

• Both items target only one part of the 
standard (central tendency), yet item 2 still 
targets multiple math skills. 

— Note: if we were interested in knowing students' 
skills with calculating the average, we could easily 
address it with a different item. 

Example 

The average of: 4, 3, 9, 4 = ? 

- A) 5 

- B) 20 
-C)4 
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Over-specific/Over-general 

Over-specific item 

Over-general item 

Who wrote the Icon of Seville? 

Which is the most serious 

A) Lorca 

problem in the world? 

B) Ibanez 

A) hunger 

C) Rodriguez 

B) lack of education 

C) disease 

Over-specific items often assess 

Over-general items are often 

trivial content. 

opinion-based. 

Balancing the generality of an item is 

part of the "art" of writing good items. 

Note. Examples from Haladyna, 2004, p. 102. 


Trick Questions 

• Is there a fourth of July in England? 

Yes, there is a fourth of July everywhere. 

• Some months have 31 days. How many have 
28? 

All of them 

• How many animals of each gender did Moses 
bring on his ship? 

None. Moses didn't have a ship, Noah did. 

• A butcher in the meat market is six feet tall. 
What does he weigh? 

Meat 

Note. Examples from Haladyna, 2004, p. 104. 
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Trick Questions 

“There are enough problems in testing 
without contributing more by using trick 
items.” (Haladyna, 2004, p. 104) 


Formatting Concerns 

• Make sure stem is a complete sentence/ 
directive. 

• Make sure item is multiple choice, and 
contains three options (correct response and 
two plausible distracters). 

• Correct response is always answer Option A 

— Because items will be computer-administered, we 
will randomly rotate all options. For development 
purposes, it's easiest to always keep the correct 
response in a consistent location. 

All other formatting concerns are BRT responsibility 
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Style Concerns 

• Please proof read all items you wrote before you 
turn them over to me (both Writers and 
Reviewers) 

• Primary things to look for: 

— Grammar 

- Can the reading load be reduced without losing 
clarity? 

— Is there more than one construct/skill? 

— Bias and sensitivity (i.e., variety of diverse names - 
Google them!) 


Stem Construction 

• Try to be as clear and concise as possible 

• Make sure the stem is complete and contains 
all the information needed to solve the 
problem. 
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Developing Options (correct option 
and two plausible distractors) 

• Probably the most difficult part of an item to 
develop. 

• Answer options must be reasonable and have 
only one justifiably correct answer (e.g., if you 
can make a reasonable argument that one of 
the distracters is also correct, it is not a good 
distracter). 

• You're an expert!!! Think about the common 
math mistakes your students make! 


Developing Options (cont.) 

In a perfectly functioning item... 

• Stem contains all the information needed to 
solve the question 

— Answer option A is the correct response, and will be 
chosen by students who understand the content 
targeted by the item. 

— Answer option B is a close distracter, and will be 
chosen by students who have partial, but incomplete 
knowledge of the content targeted by the item. 

— Answer option C is a far distracter (but not TOO far), 
and will be chosen by students who have little to no 
knowledge of the content targeted by the item. 
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Developing Options (cont.) 

• Keep format of each option the same (length, 
grammar, etc.) 

• Do not use "all of the above" or "none of the 
above" 

• Keep distracters plausible, but avoid hinting at 
the correct response. 

• Try to use distracters that represent typical 
student errors 


Developing Options (cont.) 

• Although guidelines can help, coming up with 
reasonable options is difficult. Getting the 
options to all function the way they are 
intended to is even more difficult. 

— Why some refer to item writing as an art (as 
opposed to a science) it's a little of both 
though! 
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Hypothetical Example 

• Imagine a kindergarten or first grade standard 
that requires students have knowledge of 
basic geometric shapes - faces, sides, angles, 
etc. 

— i.e., squares, circles, triangles, rectangles, etc. 


Item Non-Example 

Greg and Sally were both in the first grade. Greg 
liked the color blue and always wore a blue shirt. 
Sally liked the color green and always wore a 
green shirt. Which shirt has more triangles on 
it? 



a) blue c) Sally e) triangles 

b) green d) Greg 
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Why this is a poor item 

• Way too much text 

• Lots of irrelevant information 

• Low-cognitive-level question (basically counting - 
though some standards this skill is targeted) 

• What if the student is color blind? 

• Too many options 

- Not logical distracters 

— There is arguably more than one correct response 
option (either blue or Greg) 

• Doesn't really address the standard 


Item non-example 2 

Triangles: 

a) have three sides 

b) have two long sides and two short sides 

c) have rounded edges 

d) all of the above 

e) none of the above 
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Why this is a poor item 

• Stem does not present the information 
needed solve the problem. 

• Uses the "all of the above" and "none of the 
above" options 

— Although there is some empirical evidence 
supporting that the "all of the above" option 
increases the difficulty (Huang, Trevisan, & 
Storfer, 2007), the general consensus is that it 
creates a "cueing" effect for students. Also, 
students may choose these options with mis- or 
partial knowledge. 



easyCBM CCSS First Grade Math Measure Development 


66 

Appendix A: Training 


Why is this a better item? 

• Clearly addresses the standard 

• Low level of text 

• No irrelevant information 


Language Issues 


For math items, excess text threatens validity 

- Particularly worrisome for English language 
learners (ELL) 


What to do? 


— Use familiar, grade- 
level appropriate 
words 

— Omit all unnecessary 
words 

— Use no text if possible, 
or keep sentences as 
brief as possible 


— Avoid conditional 
and relative clauses 

— Avoid negation 

— Use concrete 
versus abstract 
representation 
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Now.... Time to look at some real items! 

Existing easyCBM items 


Existing easyCBM items 

• Note. There's only a limited amount we can 
learn from these items 

— Aligned to different standards 
— Developed for a different population 

However 

• Formatting will be similar 

• Universal design features evident 

• Good item writing principles applied 

• Perhaps most important - We know they work! 
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Existing easyCBM item 

Standard: Solve problems about similar objects (including figures) by using scale 
factors that relate corresponding lengths of the objects or by using the fact that 
relationships of lengths within an object are preserved in similar objects. 

• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignment? 

• Other concerns? 

a. \ in. Remember: These items were designed for very low 

b. 4 in. performing students. The new items should target 

c. 5 in. students at or slightly below grade-level expectations. 



Existing easyCBM item 

Standard: Use descriptive statistics, including mean, median, and range, to summarize 
and compare data sets. 



B. $9 

C. $12 


• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignment? 

• Other concerns? 
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One more... 

Standard: Explain why the sum of the measures of the angles in a triangle is 180 
degrees, and they apply this fact about triangles to find unknown measures of angles. 

• Universal Design features? 

• Targets a single skill? 

• Over-specific/over-general? 

• Clear and concise? 

• Alignment? 

• Other concerns? 

A. 38° 

B. 71° 

C. 16° 



How do you become a good item writer? 

“Effective item writers are trained, not 
born... Although item writers must be 
expert in their own disciplines, there is no 
reason to believe that their subject matter 
expertise generalizes to effective item 
writing expertise.” 

(Downing, 2006, p. 11) 
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Bottom line 

“Practice does not make perfect. Only 
perfect practice makes perfect.” 
-Vince Lombardi 

• Practice, practice, practice. 

- Practice writing different types of items 

• Geometry, number & operation, etc. 

- Look back at other test items 

• Find examples of good and bad items 


Resources 

• Multiple choice item writing Do's and Don'ts 

— http://www.eric.ed.gov/PDFS/ED398238.pdf 

• Recommendations portion of the following 
IDEA paper 

- http://www.theideacenter.org/IDEAPaperl6 

Plenty more resources online can be found with 
a quick Google search. 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

1 

1 

1MD219 

-0.97 

71 

62 

0.38 

0.78 

-0.89 

0.52 

-1.12 

0.48 

1.21 

1 

2 

1MD110 

0.10 

81 

61 

0.28 

1.09 

0.67 

1.09 

0.48 

0.27 

0.85 

1 

3 

1MD17 

1.31 

72 

45 

0.27 

1.07 

0.66 

1.07 

0.43 

0.39 

0.85 

1 

4 

1G230 

-2.26 

83 

80 

0.60 

0.91 

-0.02 

0.41 

-0.66 

0.28 

1.08 

1 

5 

1G215 

-1.70 

83 

78 

0.47 

0.94 

-0.04 

0.58 

-0.58 

0.28 

1.06 

1 

6 

1G322 

-1.00 

86 

76 

0.36 

0.97 

-0.06 

0.70 

-0.53 

0.34 

1.05 

1 

7 

30118 

-0.59 

21 

17 

0.61 

0.79 

-0.70 

0.56 

-0.40 

0.47 

1.38 

1 

8 

30105 

0.01 

25 

18 

0.52 

0.80 

-0.73 

0.92 

-0.03 

0.56 

1.24 

1 

9 

10436 

0.91 

24 

14 

0.50 

0.91 

-0.33 

0.90 

-0.13 

0.60 

1.16 

1 

10 

1G332 

1.74 

72 

39 

0.27 

1.12 

1.14 

1.11 

0.75 

0.36 

0.71 

1 

11 

10A415 

-0.50 

80 

67 

0.32 

0.95 

-0.21 

0.71 

-0.89 

0.38 

1.10 

1 

12 

10A45 

-0.08 

73 

58 

0.32 

1.05 

0.36 

0.85 

-0.38 

0.38 

0.98 

1 

13 

10A418 

0.14 

77 

59 

0.30 

0.92 

-0.47 

0.73 

-0.91 

0.50 

1.14 

1 

14 

1NBT614 

0.71 

73 

49 

0.28 

0.98 

-0.12 

0.95 

-0.17 

0.45 

1.04 

1 

15 

10A224 

0.86 

70 

48 

0.27 

0.89 

-1.04 

0.79 

-1.11 

0.46 

1.31 

1 

16 

10191 

1.21 

22 

13 

0.50 

0.61 

-2.24 

0.50 

-1.38 

0.73 

1.91 

1 

17 

10072 

1.54 

23 

9 

0.50 

1.09 

0.45 

1.95 

2.05 

0.41 

0.58 

1 

18 

1MD32 

-0.02 

70 

60 

0.36 

0.99 

0.05 

0.88 

-0.11 

0.32 

1.01 

1 

19 

10283 

-1.62 

23 

21 

0.83 

0.75 

-0.25 

0.46 

-0.06 

0.51 

1.15 

1 

20 

10310 

-1.30 

24 

21 

0.72 

0.99 

0.12 

1.26 

0.59 

0.39 

0.94 

1 

21 

10163 

-0.74 

23 

19 

0.59 

1.16 

0.61 

1.12 

0.40 

0.25 

0.79 

1 

22 

10355 

-0.48 

24 

20 

0.61 

1.39 

1.13 

2.36 

1.36 

0.12 

0.40 

1 

23 

30756 

0.18 

17 

11 

0.60 

1.36 

1.47 

1.46 

0.98 

0.33 

0.08 

1 

24 

10122 

0.82 

24 

12 

0.49 

1.07 

0.39 

0.88 

-0.14 

0.54 

0.94 

1 

25 

10314 

1.34 

24 

12 

0.50 

1.23 

1.06 

1.44 

1.43 

0.45 

0.41 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

2 

1 

1MD28 

-0.92 

76 

69 

0.41 

0.88 

-0.31 

0.56 

-0.76 

0.35 

1.12 

2 

2 

1MD229 

0.07 

146 

113 

0.22 

1.02 

0.25 

1.08 

0.42 

0.38 

0.95 

2 

3 

1MD24 

1.25 

70 

47 

0.28 

0.86 

-1.22 

0.73 

-1.23 

0.54 

1.34 

2 

4 

10431 

-2.52 

22 

20 

1.05 

1.12 

0.42 

1.04 

0.50 

0.54 

0.92 

2 

5 

30701 

-1.54 

21 

18 

0.66 

0.80 

-0.41 

0.44 

-0.61 

0.52 

1.25 

2 

6 

30421 

-0.95 

24 

20 

0.60 

0.81 

-0.58 

0.52 

-0.55 

0.47 

1.29 

2 

7 

30422 

-0.53 

25 

18 

0.52 

1.27 

1.18 

1.88 

1.39 

0.30 

0.36 

2 

8 

30707 

0.04 

23 

17 

0.60 

0.92 

-0.20 

0.62 

-0.33 

0.62 

1.19 

2 

9 

1G25 

0.86 

73 

47 

0.27 

1.05 

0.45 

1.00 

0.07 

0.41 

0.92 

2 

10 

31020 

1.80 

25 

12 

0.51 

0.98 

0.00 

1.07 

0.30 

0.62 

1.00 

2 

11 

10A48 

-0.50 

80 

67 

0.32 

0.82 

-0.92 

0.65 

-1.12 

0.46 

1.20 

2 

12 

10A26 

-0.06 

87 

73 

0.31 

0.86 

-0.77 

0.65 

-0.93 

0.44 

1.18 

2 

13 

1NBT615 

0.15 

73 

59 

0.32 

0.80 

-1.16 

0.60 

-1.38 

0.49 

1.27 

2 

14 

10174 

0.75 

24 

11 

0.47 

1.15 

0.85 

1.49 

1.38 

0.36 

0.43 

2 

15 

1NBT515 

0.88 

88 

61 

0.25 

1.01 

0.17 

1.07 

0.39 

0.36 

0.94 

2 

16 

1NBT639 

1.17 

149 

89 

0.19 

1.05 

0.75 

1.05 

0.45 

0.38 

0.86 

2 

17 

10157 

1.58 

24 

11 

0.46 

1.31 

1.57 

1.94 

2.71 

0.15 

-0.01 

2 

18 

1MD314 

-0.02 

70 

57 

0.34 

0.92 

-0.40 

1.38 

0.98 

0.40 

1.02 

2 

19 

10201 

-1.62 

168 

158 

0.34 

0.89 

-0.36 

0.50 

-0.95 

0.33 

1.09 

2 

20 

10081 

-1.41 

24 

21 

0.68 

1.21 

0.60 

1.02 

0.36 

0.29 

0.85 

2 

21 

10213 

-0.73 

23 

19 

0.63 

0.86 

-0.39 

0.63 

-0.15 

0.49 

1.20 

2 

22 

10292 

-0.49 

24 

19 

0.56 

1.32 

1.07 

1.58 

1.09 

0.22 

0.57 

2 

23 

10019 

0.18 

23 

14 

0.49 

1.03 

0.22 

2.52 

2.47 

0.37 

0.59 

2 

24 

1NBT314 

0.82 

74 

52 

0.28 

1.07 

0.58 

0.99 

0.01 

0.33 

0.90 

2 

25 

1NBT311 

1.31 

72 

45 

0.27 

0.86 

-1.25 

0.79 

-1.25 

0.57 

1.33 
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Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

3 

1 

1MD227 

-0.90 

71 

65 

0.44 

0.90 

-0.21 

0.55 

-0.80 

0.34 

1.10 

3 

2 

1MD13 

-0.04 

77 

61 

0.31 

0.75 

-1.53 

0.54 

-1.63 

0.60 

1.32 

3 

3 

1MD18 

1.76 

76 

37 

0.25 

0.96 

-0.40 

0.91 

-0.64 

0.46 

1.15 

3 

4 

1G116 

-2.26 

148 

143 

0.47 

1.10 

0.39 

0.89 

0.09 

0.13 

0.95 

3 

5 

30746 

-1.71 

28 

26 

0.78 

0.76 

-0.29 

0.31 

-0.41 

0.42 

1.21 

3 

6 

30598 

-0.95 

23 

20 

0.69 

1.29 

0.82 

2.49 

1.27 

0.15 

0.53 

3 

7 

31180 

-0.45 

28 

23 

0.54 

1.12 

0.46 

1.28 

0.62 

0.28 

0.83 

3 

8 

30413 

0.04 

24 

17 

0.52 

1.12 

0.58 

1.09 

0.35 

0.44 

0.81 

3 

9 

30519 

0.89 

15 

9 

0.65 

0.86 

-0.39 

0.69 

-0.43 

0.65 

1.30 

3 

10 

1G234 

1.85 

71 

35 

0.27 

1.07 

0.64 

1.10 

0.70 

0.42 

0.81 

3 

11 

10059 

-0.48 

178 

150 

0.23 

0.96 

-0.22 

0.80 

-0.67 

0.42 

1.05 

3 

12 

1NBT510 

-0.02 

70 

58 

0.33 

0.98 

-0.01 

1.10 

0.39 

0.25 

0.99 

3 

13 

10A811 

0.16 

155 

120 

0.21 

1.04 

0.41 

1.49 

2.36 

0.25 

0.87 

3 

14 

10171 

0.76 

24 

15 

0.51 

1.14 

0.69 

0.94 

0.02 

0.51 

0.82 

3 

15 

10130 

0.87 

22 

11 

0.52 

0.60 

-1.87 

0.48 

-1.19 

0.76 

1.75 

3 

16 

10A22 

1.15 

73 

43 

0.27 

1.20 

1.74 

1.26 

1.53 

0.29 

0.51 

3 

17 

1NBT59 

1.59 

88 

49 

0.24 

0.92 

-0.82 

0.88 

-0.79 

0.49 

1.23 

3 

18 

1MD327 

-0.11 

86 

67 

0.28 

0.90 

-0.65 

0.83 

-0.52 

0.44 

1.14 

3 

19 

10146 

-1.62 

22 

20 

0.80 

0.76 

-0.32 

0.29 

-0.25 

0.49 

1.23 

3 

20 

10084 

-1.41 

24 

22 

0.77 

1.01 

0.20 

0.88 

0.36 

0.23 

0.99 

3 

21 

10271 

-0.73 

24 

18 

0.53 

0.97 

-0.06 

0.70 

-0.26 

0.45 

1.15 

3 

22 

10219 

-0.51 

23 

17 

0.53 

1.07 

0.37 

1.90 

1.29 

0.30 

0.65 

3 

23 

10142 

0.19 

173 

134 

0.20 

0.90 

-0.96 

0.75 

-1.26 

0.48 

1.16 

3 

24 

30606 

0.82 

16 

10 

0.60 

0.90 

-0.31 

0.80 

-0.22 

0.55 

1.21 

3 

25 

10044 

1.31 

22 

11 

0.55 

0.66 

-1.51 

0.55 

-0.95 

0.75 

1.64 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

4 

1 

1MD131 

-0.88 

80 

71 

0.38 

0.90 

-0.33 

0.64 

-0.65 

0.40 

1.10 

4 

2 

1MD113 

-0.04 

77 

61 

0.31 

1.00 

0.05 

0.98 

0.05 

0.41 

0.99 

4 

3 

1MD232 

1.90 

95 

46 

0.23 

1.08 

0.98 

1.07 

0.57 

0.36 

0.76 

4 

4 

10418 

-2.48 

23 

22 

1.05 

0.77 

0.00 

0.21 

-0.39 

0.36 

1.17 

4 

5 

31193 

-1.54 

22 

19 

0.71 

0.87 

-0.14 

3.54 

1.84 

0.31 

0.87 

4 

6 

1G23 

-1.00 

86 

76 

0.36 

1.04 

0.24 

1.15 

0.46 

0.24 

0.94 

4 

7 

10446 

-0.49 

23 

19 

0.63 

0.65 

-0.94 

0.41 

-0.98 

0.62 

1.38 

4 

8 

30725 

0.05 

22 

17 

0.63 

1.01 

0.13 

1.13 

0.40 

0.55 

0.93 

4 

9 

1G334 

0.78 

73 

48 

0.28 

1.15 

1.20 

1.22 

1.11 

0.32 

0.69 

4 

10 

30735 

1.82 

18 

5 

0.58 

0.75 

-0.89 

0.57 

-0.87 

0.63 

1.45 

4 

11 

10077 

-0.45 

24 

20 

0.68 

0.47 

-1.48 

0.26 

-1.05 

0.71 

1.49 

4 

12 

1NBT520 

-0.08 

73 

58 

0.32 

0.91 

-0.46 

0.88 

-0.27 

0.45 

1.09 

4 

13 

10097 

0.16 

24 

17 

0.52 

0.96 

-0.09 

0.78 

-0.45 

0.51 

1.14 

4 

14 

10A217 

0.75 

72 

52 

0.29 

0.88 

-0.88 

0.71 

-1.27 

0.54 

1.25 

4 

15 

1NBT612 

0.92 

72 

50 

0.28 

1.12 

0.96 

1.22 

1.02 

0.31 

0.74 

4 

16 

1NBT535 

1.25 

76 

45 

0.26 

1.02 

0.30 

0.95 

-0.26 

0.39 

0.97 

4 

17 

1NBT513 

1.63 

71 

38 

0.27 

1.03 

0.30 

0.97 

-0.14 

0.45 

0.96 

4 

18 

1MD312 

-0.41 

81 

67 

0.31 

0.95 

-0.23 

0.83 

-0.50 

0.36 

1.07 

4 

19 

10338 

-1.64 

21 

20 

1.04 

0.96 

0.24 

0.45 

-0.02 

0.27 

1.07 

4 

20 

10349 

-1.41 

21 

17 

0.61 

1.09 

0.43 

0.72 

0.12 

0.36 

0.93 

4 

21 

1NBT51 

-0.73 

81 

70 

0.34 

1.07 

0.40 

1.63 

1.57 

0.15 

0.86 

4 

22 

10276 

-0.50 

23 

19 

0.63 

0.68 

-0.91 

0.40 

-0.75 

0.60 

1.38 

4 

23 

10182 

0.18 

22 

14 

0.51 

0.89 

-0.47 

0.73 

-0.59 

0.54 

1.29 

4 

24 

10385 

0.83 

21 

13 

0.51 

0.65 

-1.81 

0.52 

-1.36 

0.72 

1.76 

4 

25 

1NBT21 

1.30 

77 

44 

0.26 

0.79 

-1.99 

0.70 

-1.99 

0.63 

1.50 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

5 

1 

1MD14 

-0.87 

70 

65 

0.48 

0.97 

0.05 

0.58 

-0.41 

0.29 

1.05 

5 

2 

1MD221 

-0.05 

76 

62 

0.31 

0.89 

-0.58 

0.67 

-0.96 

0.41 

1.17 

5 

3 

1MD118 

1.25 

70 

47 

0.28 

0.96 

-0.26 

0.94 

-0.20 

0.44 

1.07 

5 

4 

30403 

-2.29 

20 

19 

1.05 

0.94 

0.22 

0.40 

-0.08 

0.30 

1.08 

5 

5 

10422 

-1.72 

23 

21 

0.76 

1.14 

0.42 

1.20 

0.55 

0.06 

0.88 

5 

6 

1G115 

-0.94 

76 

66 

0.37 

0.81 

-0.79 

0.58 

-1.00 

0.47 

1.18 

5 

7 

30117 

-0.52 

24 

18 

0.52 

1.22 

0.90 

0.98 

0.14 

0.29 

0.74 

5 

8 

30743 

0.05 

19 

12 

0.57 

1.20 

0.88 

0.95 

0.16 

0.45 

0.70 

5 

9 

1G336 

0.84 

86 

53 

0.25 

1.01 

0.12 

1.03 

0.22 

0.42 

0.96 

5 

10 

1G39 

1.78 

75 

39 

0.26 

1.27 

2.72 

1.28 

2.04 

0.22 

0.13 

5 

11 

10A412 

-0.44 

73 

64 

0.37 

0.83 

-0.65 

0.54 

-1.12 

0.43 

1.18 

5 

12 

10A23 

-0.14 

77 

62 

0.32 

0.72 

-1.66 

0.51 

-1.63 

0.61 

1.33 

5 

13 

10127 

0.17 

22 

15 

0.52 

1.27 

1.12 

1.25 

0.73 

0.26 

0.54 

5 

14 

1OA210 

0.72 

70 

49 

0.29 

1.13 

0.99 

0.99 

0.03 

0.35 

0.82 

5 

15 

1NBT617 

0.94 

80 

48 

0.25 

1.08 

0.87 

1.10 

0.78 

0.33 

0.75 

5 

16 

10176 

1.22 

24 

11 

0.51 

1.01 

0.10 

0.84 

-0.23 

0.59 

1.04 

5 

17 

1NBT54 

1.62 

70 

37 

0.26 

0.99 

-0.08 

0.97 

-0.18 

0.38 

1.04 

5 

18 

1MD315 

-0.43 

144 

125 

0.26 

1.11 

0.70 

1.69 

1.87 

0.17 

0.84 

5 

19 

10300 

-1.64 

24 

21 

0.80 

0.59 

-0.64 

0.23 

-0.44 

0.74 

1.29 

5 

20 

10256 

-1.39 

23 

19 

0.61 

1.31 

0.93 

1.26 

0.56 

0.24 

0.67 

5 

21 

10302 

-0.72 

23 

19 

0.60 

0.85 

-0.37 

0.54 

-0.41 

0.48 

1.23 

5 

22 

10376 

-0.52 

24 

18 

0.54 

0.68 

-1.41 

0.46 

-0.77 

0.62 

1.54 

5 

23 

10017 

0.17 

23 

16 

0.53 

0.75 

-1.05 

0.58 

-0.81 

0.63 

1.48 

5 

24 

10383 

0.85 

24 

12 

0.47 

1.08 

0.50 

0.99 

0.07 

0.44 

0.84 

5 

25 

1NBT318 

1.29 

70 

43 

0.29 

1.02 

0.20 

1.02 

0.19 

0.48 

0.94 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

6 

1 

1MD230 

-0.87 

71 

64 

0.42 

0.98 

0.04 

0.82 

-0.13 

0.30 

1.02 

6 

2 

1MD129 

-0.06 

71 

58 

0.34 

0.99 

0.02 

0.93 

-0.06 

0.39 

1.01 

6 

3 

1MD120 

1.27 

73 

37 

0.26 

0.89 

-1.11 

1.03 

0.23 

0.50 

1.23 

6 

4 

10408 

-2.47 

24 

23 

1.07 

1.22 

0.52 

1.12 

0.55 

0.14 

0.82 

6 

5 

1G140 

-1.53 

71 

67 

0.53 

0.87 

-0.18 

0.40 

-0.66 

0.35 

1.11 

6 

6 

30583 

-0.94 

19 

16 

0.67 

0.93 

-0.08 

0.58 

-0.18 

0.38 

1.16 

6 

7 

31018 

-0.46 

17 

12 

0.60 

1.09 

0.43 

0.95 

0.10 

0.39 

0.87 

6 

8 

30114 

0.06 

166 

128 

0.20 

1.06 

0.62 

1.51 

2.13 

0.31 

0.84 

6 

9 

10426 

0.81 

22 

13 

0.52 

0.92 

-0.30 

0.76 

-0.29 

0.58 

1.19 

6 

10 

1G343 

1.95 

95 

45 

0.23 

0.97 

-0.32 

1.00 

0.07 

0.45 

1.05 

6 

11 

10060 

-0.43 

177 

148 

0.22 

0.85 

-1.12 

0.66 

-1.39 

0.50 

1.17 

6 

12 

10064 

-0.15 

22 

16 

0.54 

0.73 

-1.10 

0.60 

-0.98 

0.56 

1.50 

6 

13 

10A215 

0.17 

70 

51 

0.30 

0.82 

-1.25 

0.69 

-1.36 

0.55 

1.31 

6 

14 

10175 

0.77 

23 

14 

0.48 

1.25 

1.17 

1.14 

0.55 

0.29 

0.54 

6 

15 

10102 

0.95 

24 

17 

0.54 

1.24 

0.89 

1.15 

0.49 

0.44 

0.69 

6 

16 

10A214 

1.25 

70 

47 

0.28 

0.89 

-0.92 

0.74 

-1.18 

0.53 

1.28 

6 

17 

10187 

1.68 

23 

12 

0.53 

1.45 

1.64 

1.96 

2.05 

0.37 

0.09 

6 

18 

1MD320 

-0.67 

70 

59 

0.36 

0.84 

-0.68 

0.68 

-0.79 

0.46 

1.17 

6 

19 

10311 

-1.68 

23 

21 

0.79 

1.33 

0.75 

9.90 

2.92 

-0.02 

0.26 

6 

20 

10307 

-1.36 

23 

19 

0.63 

0.75 

-0.64 

0.50 

-0.38 

0.58 

1.27 

6 

21 

10109 

-0.71 

22 

19 

0.67 

1.25 

0.71 

1.05 

0.39 

0.22 

0.78 

6 

22 

10088 

-0.50 

24 

18 

0.54 

1.14 

0.66 

2.32 

1.72 

0.33 

0.58 

6 

23 

10113 

0.17 

24 

16 

0.51 

0.86 

-0.66 

0.74 

-0.60 

0.58 

1.33 

6 

24 

1NBT324 

0.85 

73 

43 

0.27 

0.87 

-1.26 

0.84 

-0.96 

0.54 

1.33 

6 

25 

10140 

1.29 

24 

11 

0.49 

0.70 

-1.47 

0.60 

-1.57 

0.63 

1.67 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

7 

1 

1MD12 

-0.82 

71 

61 

0.37 

0.84 

-0.67 

0.52 

-1.24 

0.48 

1.19 

7 

2 

1MD222 

-0.08 

73 

58 

0.32 

0.99 

0.02 

0.94 

-0.08 

0.40 

1.01 

7 

3 

1MD127 

1.49 

148 

82 

0.19 

1.33 

3.75 

1.53 

3.88 

0.26 

0.17 

7 

4 

30106 

-2.31 

23 

21 

0.93 

0.30 

-1.31 

0.10 

-0.67 

0.69 

1.40 

7 

5 

30518 

-1.71 

32 

28 

0.57 

0.97 

0.05 

0.89 

0.22 

0.30 

1.01 

7 

6 

30709 

-0.98 

18 

15 

0.69 

1.08 

0.33 

1.02 

0.39 

0.31 

0.88 

7 

7 

1G214 

-0.46 

86 

71 

0.31 

1.37 

1.95 

1.92 

2.13 

0.00 

0.50 

7 

8 

31014 

0.05 

24 

16 

0.49 

0.93 

-0.30 

0.82 

-0.29 

0.50 

1.18 

7 

9 

30561 

0.71 

23 

13 

0.47 

0.66 

-2.01 

0.57 

-1.57 

0.71 

1.86 

7 

10 

1G311 

1.92 

71 

34 

0.27 

1.09 

0.84 

1.21 

1.30 

0.39 

0.72 

7 

11 

10071 

-0.40 

22 

17 

0.57 

1.08 

0.37 

0.88 

0.03 

0.38 

0.93 

7 

12 

10A216 

-0.18 

73 

56 

0.31 

1.04 

0.32 

0.98 

0.04 

0.38 

0.96 

7 

13 

10066 

0.18 

24 

15 

0.51 

1.11 

0.54 

1.00 

0.16 

0.51 

0.83 

7 

14 

10A416 

0.78 

70 

49 

0.28 

1.08 

0.73 

1.12 

0.63 

0.23 

0.80 

7 

15 

10167 

0.93 

24 

12 

0.52 

0.87 

-0.41 

1.18 

0.56 

0.64 

1.10 

7 

16 

10137 

1.25 

23 

12 

0.50 

1.09 

0.46 

0.88 

-0.22 

0.54 

0.94 

7 

17 

10173 

1.63 

187 

93 

0.17 

1.09 

1.34 

1.04 

0.43 

0.42 

0.79 

7 

18 

1MD329 

-1.10 

71 

66 

0.47 

0.92 

-0.09 

0.58 

-0.61 

0.30 

1.08 

7 

19 

10312 

-1.71 

23 

20 

0.77 

0.51 

-1.05 

0.20 

-0.44 

0.72 

1.37 

7 

20 

10295 

-1.35 

23 

21 

0.77 

1.04 

0.25 

0.62 

-0.08 

0.29 

1.03 

7 

21 

10273 

-0.69 

191 

172 

0.25 

0.90 

-0.49 

0.59 

-1.16 

0.37 

1.10 

7 

22 

10164 

-0.49 

23 

17 

0.55 

0.77 

-0.75 

0.83 

-0.09 

0.56 

1.26 

7 

23 

10039 

0.23 

640 

430 

0.10 

0.89 

-2.60 

0.79 

-2.37 

0.56 

1.22 

7 

24 

1NBT34 

0.85 

73 

43 

0.27 

1.06 

0.63 

1.12 

0.73 

0.38 

0.80 

7 

25 

10020 

1.28 

24 

13 

0.48 

0.85 

-0.68 

0.82 

-0.46 

0.59 

1.32 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

8 

1 

1MD19 

-0.79 

73 

64 

0.38 

0.93 

-0.19 

0.80 

-0.27 

0.38 

1.05 

8 

2 

1MD26 

-0.09 

73 

55 

0.30 

0.91 

-0.53 

0.75 

-0.93 

0.49 

1.16 

8 

3 

1MD123 

2.50 

73 

24 

0.28 

1.02 

0.24 

1.94 

3.48 

0.33 

0.77 

8 

4 

31186 

-2.42 

18 

16 

1.10 

1.39 

0.71 

9.61 

2.87 

0.38 

0.25 

8 

5 

30889 

-1.54 

17 

15 

0.81 

1.31 

0.71 

1.03 

0.39 

0.14 

0.80 

8 

6 

30269 

-1.00 

27 

23 

0.64 

1.32 

0.85 

1.08 

0.39 

0.35 

0.76 

8 

7 

1G134 

-0.48 

79 

69 

0.36 

0.95 

-0.14 

0.72 

-0.57 

0.37 

1.07 

8 

8 

30745 

0.08 

14 

11 

0.74 

1.05 

0.25 

1.28 

0.59 

0.40 

0.89 

8 

9 

1G319 

0.70 

76 

53 

0.27 

1.00 

0.01 

0.93 

-0.24 

0.36 

1.02 

8 

10 

1G321 

1.85 

75 

38 

0.26 

0.82 

-2.04 

0.78 

-1.81 

0.57 

1.60 

8 

11 

10124 

-0.40 

22 

18 

0.60 

0.90 

-0.21 

0.58 

-0.42 

0.48 

1.18 

8 

12 

10A213 

-0.20 

161 

132 

0.22 

1.00 

0.03 

0.97 

-0.04 

0.34 

1.01 

8 

13 

10092 

0.20 

23 

16 

0.50 

1.17 

0.83 

1.34 

0.90 

0.25 

0.57 

8 

14 

1NBT538 

0.78 

86 

54 

0.25 

1.06 

0.65 

1.06 

0.38 

0.38 

0.85 

8 

15 

1NBT530 

0.88 

88 

61 

0.25 

1.02 

0.18 

1.01 

0.10 

0.37 

0.96 

8 

16 

10168 

1.22 

24 

12 

0.48 

1.12 

0.69 

1.17 

0.75 

0.46 

0.62 

8 

17 

10070 

1.61 

24 

12 

0.56 

1.17 

0.66 

1.30 

0.68 

0.59 

0.72 

8 

18 

1MD326 

-0.95 

74 

68 

0.44 

0.86 

-0.34 

0.66 

-0.47 

0.34 

1.10 

8 

19 

10001 

-1.72 

23 

21 

0.78 

1.02 

0.21 

0.53 

-0.21 

0.35 

1.06 

8 

20 

10373 

-1.35 

24 

20 

0.66 

0.57 

-1.10 

0.30 

-0.57 

0.69 

1.39 

8 

21 

10380 

-0.67 

23 

19 

0.62 

1.48 

1.30 

1.23 

0.54 

0.20 

0.55 

8 

22 

30760 

-0.49 

20 

15 

0.60 

1.03 

0.20 

0.71 

-0.23 

0.50 

1.04 

8 

23 

10329 

0.16 

24 

16 

0.50 

0.70 

-1.29 

0.69 

-0.72 

0.67 

1.45 

8 

24 

1NBT327 

0.86 

73 

47 

0.27 

1.06 

0.53 

1.12 

0.67 

0.39 

0.85 

8 

25 

10393 

1.27 

23 

11 

0.52 

1.13 

0.65 

1.13 

0.49 

0.52 

0.70 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

9 

1 

1MD220 

-0.73 

72 

65 

0.42 

0.90 

-0.26 

0.54 

-0.79 

0.40 

1.11 

9 

2 

1MD25 

-0.14 

71 

55 

0.31 

0.76 

-1.51 

0.69 

-1.11 

0.55 

1.32 

9 

3 

1MD218 

1.85 

70 

39 

0.27 

1.14 

1.34 

1.16 

0.95 

0.33 

0.62 

9 

4 

30261 

-2.32 

22 

20 

0.84 

0.69 

-0.43 

0.26 

-0.30 

0.57 

1.24 

9 

5 

10409 

-1.72 

24 

22 

0.78 

0.70 

-0.46 

0.28 

-0.26 

0.44 

1.26 

9 

6 

30589 

-0.94 

27 

21 

0.53 

1.20 

0.80 

1.50 

0.79 

0.33 

0.60 

9 

7 

10425 

-0.47 

24 

18 

0.54 

0.91 

-0.24 

0.79 

-0.10 

0.48 

1.14 

9 

8 

30148 

0.06 

15 

11 

0.71 

1.35 

1.00 

1.37 

0.67 

0.37 

0.53 

9 

9 

31163 

0.76 

340 

238 

0.13 

1.13 

2.16 

1.24 

2.01 

0.32 

0.73 

9 

10 

30459 

1.94 

25 

10 

0.49 

0.80 

-0.91 

0.65 

-0.82 

0.65 

1.43 

9 

11 

10057 

-0.38 

23 

17 

0.53 

0.68 

-1.34 

0.52 

-1.21 

0.61 

1.55 

9 

12 

10103 

-0.21 

193 

151 

0.19 

0.99 

-0.03 

1.05 

0.35 

0.35 

1.00 

9 

13 

10105 

0.21 

24 

16 

0.52 

0.83 

-0.73 

0.65 

-0.91 

0.60 

1.40 

9 

14 

1NBT525 

0.78 

70 

49 

0.28 

0.88 

-1.00 

0.95 

-0.17 

0.43 

1.23 

9 

15 

10135 

0.87 

189 

119 

0.17 

0.96 

-0.59 

0.89 

-0.92 

0.49 

1.12 

9 

16 

10054 

1.22 

24 

12 

0.49 

1.20 

1.00 

1.23 

0.83 

0.43 

0.52 

9 

17 

10093 

1.42 

25 

11 

0.51 

1.29 

1.17 

1.28 

0.80 

0.48 

0.56 

9 

18 

1MD318 

-0.88 

80 

71 

0.38 

0.92 

-0.26 

0.64 

-0.66 

0.40 

1.10 

9 

19 

10334 

-1.74 

24 

22 

0.77 

1.18 

0.50 

1.15 

0.55 

0.15 

0.85 

9 

20 

10220 

-1.33 

21 

17 

0.68 

0.91 

-0.09 

0.49 

-0.39 

0.63 

1.17 

9 

21 

10015 

-0.66 

24 

19 

0.57 

0.98 

0.03 

0.99 

0.21 

0.41 

1.00 

9 

22 

10372 

-0.48 

20 

14 

0.61 

1.36 

1.20 

1.32 

0.63 

0.43 

0.47 

9 

23 

10318 

0.16 

23 

17 

0.55 

0.83 

-0.62 

0.62 

-0.48 

0.59 

1.29 

9 

24 

30757 

0.86 

16 

8 

0.57 

1.40 

1.73 

1.35 

1.14 

0.25 

-0.08 

9 

25 

1NBT38 

1.26 

74 

46 

0.26 

1.05 

0.50 

1.00 

0.04 

0.37 

0.90 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

10 

1 

1MD126 

-0.73 

81 

70 

0.34 

1.07 

0.38 

1.15 

0.51 

0.21 

0.92 

10 

2 

1MD27 

-0.15 

72 

61 

0.35 

0.91 

-0.36 

0.69 

-0.72 

0.43 

1.11 

10 

3 

1MD132 

2.44 

95 

36 

0.24 

0.99 

-0.11 

0.93 

-0.47 

0.46 

1.06 

10 

4 

1G13 

-2.41 

76 

73 

0.61 

0.84 

-0.17 

0.40 

-0.50 

0.33 

1.11 

10 

5 

30595 

-1.59 

26 

23 

0.68 

1.14 

0.47 

0.83 

0.26 

0.33 

0.91 

10 

6 

30591 

-0.95 

19 

17 

0.79 

0.95 

0.09 

0.52 

-0.10 

0.35 

1.11 

10 

7 

30520 

-0.50 

21 

15 

0.54 

1.43 

1.69 

1.42 

0.90 

0.13 

0.27 

10 

8 

1G317 

0.09 

72 

59 

0.33 

1.01 

0.09 

0.92 

-0.12 

0.37 

1.01 

10 

9 

1G221 

0.70 

145 

91 

0.19 

1.10 

1.26 

1.09 

0.74 

0.37 

0.78 

10 

10 

10420 

1.94 

24 

9 

0.57 

1.19 

0.65 

1.25 

0.62 

0.59 

0.79 

10 

11 

10A219 

-0.38 

148 

125 

0.25 

0.87 

-0.85 

0.63 

-1.32 

0.47 

1.15 

10 

12 

10A425 

-0.21 

168 

134 

0.21 

0.90 

-0.93 

0.78 

-1.08 

0.43 

1.15 

10 

13 

1NBT514 

0.26 

80 

60 

0.29 

0.94 

-0.39 

0.83 

-0.60 

0.45 

1.11 

10 

14 

1NBT536 

0.78 

73 

48 

0.28 

0.86 

-1.13 

0.75 

-1.30 

0.56 

1.31 

10 

15 

1NBT511 

0.87 

70 

48 

0.30 

0.97 

-0.18 

0.82 

-0.74 

0.51 

1.11 

10 

16 

10166 

1.27 

189 

116 

0.17 

1.01 

0.20 

0.98 

-0.09 

0.45 

0.98 

10 

17 

1NBT516 

1.41 

70 

45 

0.28 

0.84 

-1.43 

0.71 

-1.48 

0.57 

1.41 

10 

18 

1MD328 

-0.85 

81 

71 

0.35 

0.95 

-0.13 

0.95 

-0.01 

0.31 

1.04 

10 

19 

10272 

-1.74 

24 

21 

0.75 

0.76 

-0.36 

0.32 

-0.37 

0.60 

1.23 

10 

20 

10262 

-1.33 

22 

19 

0.69 

0.66 

-0.73 

0.36 

-0.73 

0.58 

1.32 

10 

21 

10021 

-0.66 

23 

18 

0.55 

0.93 

-0.19 

0.71 

-0.53 

0.40 

1.18 

10 

22 

10399 

-0.47 

24 

19 

0.59 

0.74 

-0.80 

0.47 

-0.53 

0.59 

1.36 

10 

23 

10107 

0.22 

24 

17 

0.53 

0.65 

-1.63 

0.44 

-0.94 

0.68 

1.61 

10 

24 

10291 

0.87 

24 

12 

0.53 

0.93 

-0.18 

0.75 

-0.54 

0.66 

1.16 

10 

25 

10121 

1.26 

23 

11 

0.52 

0.91 

-0.26 

1.15 

0.50 

0.61 

1.04 
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Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMF 

1 

1MD226 

-0.73 

155 

137 

0.26 

1.04 

0.25 

0.99 

0.08 

0.23 

0.97 

BMF 

2 

1MD117 

-0.15 

95 

80 

0.30 

0.82 

-0.98 

1.97 

2.17 

0.41 

1.14 

BMF 

3 

1MD231 

1.69 

80 

39 

0.25 

0.96 

-0.45 

0.93 

-0.42 

0.48 

1.13 

BMF 

4 

1G31 

-2.33 

71 

69 

0.73 

0.92 

0.08 

0.31 

-0.48 

0.26 

1.08 

BMF 

5 

30110 

-1.65 

20 

18 

0.77 

0.88 

-0.05 

0.50 

0.03 

0.33 

1.14 

BMF 

6 

1G229 

-0.95 

148 

133 

0.29 

0.87 

-0.60 

0.56 

-1.16 

0.42 

1.12 

BMF 

7 

1G122 

-0.54 

85 

72 

0.32 

1.09 

0.51 

2.06 

2.61 

0.15 

0.83 

BMF 

8 

1G123 

0.13 

81 

65 

0.31 

1.14 

0.84 

1.27 

0.91 

0.20 

0.79 

BMF 

9 

1G133 

0.93 

73 

46 

0.27 

1.14 

1.17 

1.11 

0.67 

0.35 

0.73 

BMF 

10 

31208 

1.72 

16 

6 

0.66 

1.21 

0.81 

1.43 

0.72 

0.50 

0.45 

BMF 

11 

10076 

-0.56 

25 

20 

0.59 

0.87 

-0.33 

0.95 

0.20 

0.53 

1.10 

BMF 

12 

1NBT58 

-0.18 

80 

65 

0.31 

0.81 

-1.08 

0.60 

-1.25 

0.52 

1.24 

BMF 

13 

10A21 

0.32 

77 

57 

0.29 

0.92 

-0.49 

0.89 

-0.34 

0.49 

1.12 

BMF 

14 

1NBT611 

0.71 

73 

45 

0.27 

0.93 

-0.60 

0.88 

-0.65 

0.49 

1.18 

BMF 

15 

1NBT532 

0.99 

70 

41 

0.28 

0.94 

-0.54 

0.98 

-0.07 

0.49 

1.13 

BMF 

16 

1NBT528 

1.19 

70 

43 

0.28 

1.05 

0.46 

1.11 

0.64 

0.40 

0.85 

BMF 

17 

10188 

1.51 

23 

11 

0.53 

0.92 

-0.26 

0.95 

0.02 

0.63 

1.12 

BMF 

18 

1MD33 

-0.02 

70 

57 

0.34 

1.15 

0.86 

1.71 

1.61 

0.26 

0.75 

BMF 

19 

10007 

-1.55 

641 

570 

0.14 

0.99 

-0.07 

1.30 

1.24 

0.35 

0.99 

BMF 

20 

10083 

-1.32 

24 

21 

0.66 

1.13 

0.44 

1.27 

0.58 

0.21 

0.85 

BMF 

21 

10264 

-0.74 

24 

20 

0.63 

0.58 

-1.30 

0.31 

-0.62 

0.62 

1.46 

BMF 

22 

10045 

-0.46 

21 

17 

0.66 

0.99 

0.11 

0.71 

-0.09 

0.52 

1.06 

BMF 

23 

10025 

0.21 

24 

16 

0.51 

1.49 

1.79 

1.65 

1.63 

0.20 

0.17 

BMF 

24 

10198 

0.81 

24 

13 

0.50 

0.95 

-0.17 

0.80 

-0.33 

0.59 

1.15 

BMF 

25 

10036 

1.41 

24 

11 

0.50 

0.78 

-1.02 

0.67 

-0.80 

0.68 

1.44 

BMF 

26 

2G335 

-0.98 

84 

75 

0.37 

0.87 

-0.44 

0.69 

-0.44 

0.38 

1.11 

BMF 

27 

23158 

-0.53 

45 

37 

0.44 

0.77 

-0.94 

0.61 

-0.63 

0.52 

1.27 

BMF 

28 

22183 

0.35 

2521 

1723 

0.05 

0.96 

-1.57 

0.91 

-2.07 

0.51 

1.07 

BMF 

29 

2NBT67 

0.76 

85 

56 

0.25 

0.94 

-0.58 

0.85 

-0.86 

0.47 

1.17 

BMF 

30 

22344 

1.56 

44 

19 

0.35 

0.77 

-1.73 

0.71 

-1.63 

0.61 

1.61 


Note. BMF = Benchmark Fall. 



easyCBM CCSS First Grade Math Measure Development 


83 

Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMW 

1 

1MD111 

-0.72 

72 

65 

0.41 

0.91 

-0.20 

0.92 

0.02 

0.28 

1.06 

BMW 

2 

1MD21 

-0.20 

75 

64 

0.35 

1.04 

0.27 

0.91 

-0.10 

0.27 

0.98 

BMW 

3 

1MD217 

1.54 

95 

53 

0.23 

1.10 

1.17 

1.08 

0.59 

0.34 

0.72 

BMW 

4 

1G31 

-2.33 

71 

69 

0.73 

0.92 

0.08 

0.31 

-0.48 

0.26 

1.08 

BMW 

5 

1G223 

-1.60 

75 

69 

0.45 

0.78 

-0.61 

0.41 

-1.02 

0.44 

1.17 

BMW 

6 

1G229 

-0.95 

148 

133 

0.29 

0.87 

-0.60 

0.56 

-1.16 

0.42 

1.12 

BMW 

7 

1G24 

-0.56 

72 

64 

0.40 

0.92 

-0.20 

0.77 

-0.31 

0.37 

1.07 

BMW 

8 

31012 

0.09 

30 

21 

0.46 

0.90 

-0.38 

0.79 

-0.47 

0.53 

1.19 

BMW 

9 

1G337 

0.92 

81 

49 

0.25 

1.07 

0.75 

1.10 

0.74 

0.33 

0.78 

BMW 

10 

31208 

1.72 

16 

6 

0.66 

1.21 

0.81 

1.43 

0.72 

0.50 

0.45 

BMW 

11 

10095 

-0.56 

22 

19 

0.70 

0.55 

-1.28 

0.28 

-0.56 

0.63 

1.48 

BMW 

12 

10A413 

-0.18 

146 

118 

0.23 

0.95 

-0.32 

0.77 

-0.90 

0.44 

1.09 

BMW 

13 

10A211 

0.26 

80 

60 

0.29 

0.96 

-0.26 

0.91 

-0.26 

0.43 

1.08 

BMW 

14 

1NBT619 

0.69 

70 

50 

0.30 

0.95 

-0.35 

0.77 

-0.86 

0.51 

1.14 

BMW 

15 

1NBT532 

0.99 

70 

41 

0.28 

0.94 

-0.54 

0.98 

-0.07 

0.49 

1.13 

BMW 

16 

1NBT522 

1.20 

86 

47 

0.24 

0.88 

-1.35 

0.96 

-0.22 

0.52 

1.30 

BMW 

17 

1NBT540 

1.45 

70 

41 

0.28 

1.00 

0.05 

1.02 

0.20 

0.51 

0.99 

BMW 

18 

1MD313 

0.59 

71 

52 

0.28 

1.09 

0.74 

1.26 

1.12 

0.18 

0.75 

BMW 

19 

10339 

-1.58 

23 

20 

0.69 

0.89 

-0.15 

0.44 

-0.03 

0.46 

1.17 

BMW 

20 

10003 

-1.31 

24 

20 

0.63 

0.90 

-0.16 

0.55 

-0.20 

0.51 

1.15 

BMW 

21 

10366 

-0.74 

23 

18 

0.62 

1.09 

0.37 

2.00 

1.28 

0.46 

0.76 

BMW 

22 

10045 

-0.46 

21 

17 

0.66 

0.99 

0.11 

0.71 

-0.09 

0.52 

1.06 

BMW 

23 

10285 

0.21 

23 

15 

0.49 

1.19 

0.94 

1.15 

0.49 

0.34 

0.62 

BMW 

24 

10227 

0.81 

22 

15 

0.53 

0.75 

-1.09 

0.63 

-0.89 

0.64 

1.46 

BMW 

25 

30618 

1.37 

19 

9 

0.53 

0.80 

-0.88 

0.81 

-0.41 

0.60 

1.42 

BMW 

26 

2G18 

-1.01 

74 

65 

0.38 

1.22 

0.92 

1.25 

0.62 

0.13 

0.81 

BMW 

27 

23057 

-0.53 

44 

36 

0.44 

0.72 

-1.12 

0.64 

-0.62 

0.61 

1.27 

BMW 

28 

22215 

0.35 

43 

29 

0.38 

0.97 

-0.15 

1.12 

0.48 

0.48 

0.99 

BMW 

29 

21883 

0.76 

45 

27 

0.36 

1.04 

0.29 

0.96 

-0.08 

0.50 

0.95 

BMW 

30 

22181 

1.56 

45 

22 

0.34 

1.01 

0.10 

0.97 

-0.07 

0.47 

1.00 


Note. BMW = Benchmark Winter. 



easyCBM CCSS First Grade Math Measure Development 


84 

Appendix B: Item Statistics by Test Form 


Item 


Form 

Number 

Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

PTME 

Discrim 

BMS 

1 

1MD215 

-0.70 

71 

63 

0.40 

0.75 

-0.93 

0.40 

-1.27 

0.50 

1.23 

BMS 

2 

1MD119 

-0.23 

144 

120 

0.24 

1.03 

0.27 

0.87 

-0.33 

0.36 

1.00 

BMS 

3 

1MD121 

1.74 

72 

39 

0.27 

1.28 

2.47 

1.33 

2.09 

0.22 

0.27 

BMS 

4 

31200 

-2.35 

28 

26 

0.79 

0.91 

0.02 

1.46 

0.75 

0.26 

0.97 

BMS 

5 

10429 

-1.66 

23 

21 

0.81 

1.29 

0.65 

5.00 

2.22 

0.04 

0.63 

BMS 

6 

30111 

-0.96 

22 

19 

0.67 

0.88 

-0.19 

0.55 

-0.34 

0.45 

1.16 

BMS 

7 

1G24 

-0.56 

72 

64 

0.40 

0.92 

-0.20 

0.77 

-0.31 

0.37 

1.07 

BMS 

8 

31012 

0.09 

30 

21 

0.46 

0.90 

-0.38 

0.79 

-0.47 

0.53 

1.19 

BMS 

9 

1G337 

0.92 

81 

49 

0.25 

1.07 

0.75 

1.10 

0.74 

0.33 

0.78 

BMS 

10 

30149 

1.67 

26 

13 

0.46 

0.85 

-0.72 

0.74 

-0.64 

0.61 

1.35 

BMS 

11 

10A212 

-0.53 

88 

78 

0.35 

0.93 

-0.22 

0.68 

-0.56 

0.34 

1.08 

BMS 

12 

10062 

-0.18 

24 

17 

0.51 

0.99 

0.01 

0.81 

-0.34 

0.47 

1.10 

BMS 

13 

10A414 

0.26 

86 

62 

0.26 

0.86 

-1.15 

0.80 

-0.81 

0.49 

1.24 

BMS 

14 

1NBT526 

0.69 

70 

50 

0.30 

1.04 

0.33 

0.90 

-0.30 

0.45 

0.98 

BMS 

15 

10A27 

1.01 

70 

50 

0.29 

0.96 

-0.26 

0.78 

-0.80 

0.46 

1.13 

BMS 

16 

1NBT57 

1.19 

70 

43 

0.28 

1.08 

0.69 

1.15 

0.88 

0.37 

0.77 

BMS 

17 

1NBT540 

1.45 

70 

41 

0.28 

1.00 

0.05 

1.02 

0.20 

0.51 

0.99 

BMS 

18 

1MD310 

0.73 

148 

105 

0.20 

0.97 

-0.35 

0.84 

-0.95 

0.43 

1.11 

BMS 

19 

10002 

-1.60 

24 

21 

0.66 

0.89 

-0.16 

0.47 

-0.27 

0.40 

1.17 

BMS 

20 

10211 

-1.31 

21 

18 

0.68 

1.22 

0.62 

0.84 

0.12 

0.28 

0.89 

BMS 

21 

10377 

-0.74 

24 

19 

0.58 

0.93 

-0.11 

0.76 

-0.12 

0.50 

1.09 

BMS 

22 

10162 

-0.45 

23 

17 

0.52 

0.86 

-0.59 

0.73 

-0.66 

0.44 

1.32 

BMS 

23 

10285 

0.21 

23 

15 

0.49 

1.19 

0.94 

1.15 

0.49 

0.34 

0.62 

BMS 

24 

30609 

0.81 

22 

12 

0.53 

0.85 

-0.60 

0.72 

-0.62 

0.64 

1.31 

BMS 

25 

10207 

1.36 

24 

13 

0.47 

0.91 

-0.46 

0.87 

-0.41 

0.55 

1.25 

BMS 

26 

2G327 

-1.02 

68 

62 

0.46 

0.86 

-0.34 

1.22 

0.53 

0.34 

1.03 

BMS 

27 

23333 

-0.53 

45 

35 

0.41 

0.86 

-0.63 

0.70 

-0.55 

0.51 

1.20 

BMS 

28 

22110 

0.35 

43 

30 

0.40 

0.85 

-0.79 

1.21 

0.64 

0.56 

1.16 

BMS 

29 

2NBT33 

0.76 

66 

50 

0.33 

1.00 

0.03 

0.99 

0.08 

0.44 

1.00 

BMS 

30 

22316 

1.56 

45 

24 

0.37 

1.01 

0.09 

1.01 

0.13 

0.57 

0.98 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Appendix C: Distractor Statistics by Test Form 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

1 

1MD219 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1 

1 

1MD219 

A 

1 

62 

87 

1.68 

0.15 

0.81 

0.48 

1 

1 

1MD219 

B 

0 

5 

7 

-0.60 

0.35 

0.28 

-0.45 

1 

1 

1MD219 

C 

0 

4 

6 

0.41 

0.39 

0.71 

-0.20 

1 

1 

1MD219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

2 

1MD110 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1 

2 

1MD110 

A 

1 

61 

75 

1.63 

0.14 

1.08 

0.27 

1 

2 

1MD110 

B 

0 

20 

25 

0.96 

0.19 

1.10 

-0.27 

1 

2 

1MD110 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

2 

1MD110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

3 

1MD17 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1 

3 

1MD17 

A 

1 

45 

63 

2.27 

0.15 

1.06 

0.39 

1 

3 

1MD17 

B 

0 

9 

13 

1.32 

0.34 

1.02 

-0.22 

1 

3 

1MD17 

C 

0 

18 

25 

1.44 

0.24 

1.10 

-0.27 

1 

3 

1MD17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

4 

1G230 

* 

-1 

1811 

96 

1.53 

0.03 

0.00 

0.01 

1 

4 

1G230 

A 

1 

80 

96 

1.54 

0.12 

0.95 

0.28 

1 

4 

1G230 

B 

0 

3 

4 

-0.10 

0.41 

0.39 

-0.28 

1 

4 

1G230 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

4 

1G230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

5 

1G215 

* 

-1 

1811 

96 

1.53 

0.03 

0.00 

0.01 

1 

5 

1G215 

A 

1 

78 

94 

1.56 

0.12 

0.96 

0.28 

1 

5 

1G215 

B 

0 

4 

5 

0.54 

0.19 

0.66 

-0.19 

1 

5 

1G215 

C 

0 

1 

1 

-0.86 

0.00 

0.15 

-0.23 

1 

5 

1G215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

6 

1G322 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1 

6 

1G322 

A 

1 

76 

88 

1.61 

0.13 

0.97 

0.34 

1 

6 

1G322 

B 

0 

6 

7 

0.65 

0.24 

0.79 

-0.19 

1 

6 

1G322 

C 

0 

4 

5 

-0.06 

0.51 

0.47 

-0.28 

1 

6 

1G322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

7 

30118 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

-0.01 

1 

7 

30118 

A 

1 

17 

81 

2.01 

0.44 

0.85 

0.47 

1 

7 

30118 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

7 

30118 

C 

0 

2 

10 

-0.35 

0.21 

0.37 

-0.35 

1 

7 

30118 

D 

0 

2 

10 

0.07 

0.26 

0.57 

-0.28 

1 

8 

30105 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.01 

1 

8 

30105 

A 

1 

18 

72 

1.96 

0.34 

0.68 

0.56 

1 

8 

30105 

B 

0 

2 

8 

-0.38 

0.30 

0.31 

-0.31 

1 

8 

30105 

C 

0 

2 

8 

1.72 

0.69 

3.03 

0.06 

1 

8 

30105 

D 

0 

3 

12 

-1.14 

0.60 

0.18 

-0.56 

1 

9 

10436 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

1 

9 

10436 

A 

1 

14 

58 

2.14 

0.32 

0.69 

0.60 

1 

9 

10436 

B 

0 

1 

4 

1.46 

0.00 

1.34 

0.01 

1 

9 

10436 

C 

0 

7 

29 

0.16 

0.65 

1.24 

-0.48 

1 

9 

10436 

D 

0 

2 

8 

-0.13 

0.68 

0.34 

-0.28 

1 

10 

1G332 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1 

10 

1G332 

A 

1 

39 

54 

2.31 

0.16 

1.05 

0.36 

1 

10 

1G332 

B 

0 

13 

18 

1.50 

0.36 

1.35 

-0.19 

1 

10 

1G332 

C 

0 

20 

28 

1.53 

0.21 

1.04 

-0.24 

1 

10 

1G332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

11 

10A415 

* 

-1 

1814 

96 

1.53 

0.03 

0.00 

0.01 

1 

11 

10A415 

A 

1 

67 

84 

1.64 

0.13 

1.00 

0.38 

1 

11 

10A415 

B 

0 

6 

8 

0.45 

0.26 

0.61 

-0.27 

1 

11 

10A415 

C 

0 

7 

9 

0.61 

0.21 

0.69 

-0.24 

1 

11 

10A415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

12 

10A45 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1 

12 

10A45 

A 

1 

58 

79 

1.81 

0.14 

1.02 

0.38 

1 

12 

10A45 

B 

0 

7 

10 

0.85 

0.12 

0.68 

-0.22 

1 

12 

10A45 

C 

0 

8 

11 

0.68 

0.45 

0.92 

-0.29 

1 

12 

10A45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

13 

10A418 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1 

13 

10A418 

A 

1 

59 

77 

2.00 

0.15 

1.05 

0.50 

1 

13 

10A418 

B 

0 

8 

10 

0.59 

0.29 

0.62 

-0.30 

1 

13 

10A418 

C 

0 

10 

13 

0.50 

0.30 

0.65 

-0.37 

1 

13 

10A418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

14 

1NBT614 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1 

14 

1NBT614 

A 

1 

49 

67 

1.95 

0.14 

0.95 

0.45 

1 

14 

1NBT614 

B 

0 

16 

22 

1.12 

0.26 

1.19 

-0.22 

1 

14 

1NBT614 

C 

0 

8 

11 

0.36 

0.34 

0.48 

-0.39 

1 

14 

1NBT614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

15 

10A224 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

1 

15 

10A224 

A 

1 

48 

69 

2.06 

0.13 

0.91 

0.46 

1 

15 

10A224 

B 

0 

11 

16 

1.22 

0.21 

0.81 

-0.27 

1 

15 

10A224 

C 

0 

11 

16 

1.13 

0.14 

0.66 

-0.32 

1 

15 

10A224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

16 

10191 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.02 

1 

16 

10191 

A 

1 

13 

59 

2.58 

0.31 

0.58 

0.73 

1 

16 

10191 

B 

0 

3 

14 

0.33 

0.29 

0.31 

-0.43 

1 

16 

10191 

C 

0 

3 

14 

0.33 

0.21 

0.30 

-0.43 

1 

16 

10191 

D 

0 

3 

14 

1.11 

0.38 

0.72 

-0.19 

1 

17 

10072 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

1 

17 

10072 

A 

1 

9 

39 

1.92 

0.77 

2.59 

0.41 

1 

17 

10072 

B 

0 

8 

35 

0.77 

0.22 

0.96 

-0.16 

1 

17 

10072 

C 

0 

1 

4 

-0.16 

0.00 

0.32 

-0.17 

1 

17 

10072 

D 

0 

5 

22 

0.45 

0.24 

0.66 

-0.22 

1 

18 

1MD32 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1 

18 

1MD32 

A 

1 

60 

86 

2.32 

0.14 

0.98 

0.32 

1 

18 

1MD32 

B 

0 

6 

9 

1.47 

0.38 

1.02 

-0.19 

1 

18 

1MD32 

C 

0 

4 

6 

1.03 

0.42 

0.61 

-0.25 

1 

18 

1MD32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

19 

10283 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

1 

19 

10283 

A 

1 

21 

91 

1.62 

0.25 

0.73 

0.51 

1 

19 

10283 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

19 

10283 

C 

0 

2 

9 

-0.79 

1.31 

0.44 

-0.51 

1 

19 

10283 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

20 

10310 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

1 

20 

10310 

A 

1 

21 

88 

2.07 

0.43 

1.01 

0.39 

1 

20 

10310 

B 

0 

3 

13 

-0.35 

1.03 

1.31 

-0.39 

1 

20 

10310 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

20 

10310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

21 

10163 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

1 

21 

10163 

A 

1 

19 

83 

1.46 

0.32 

1.11 

0.25 

1 

21 

10163 

B 

0 

2 

9 

-0.19 

0.10 

0.39 

-0.35 

1 

21 

10163 

C 

0 

2 

9 

1.36 

0.16 

1.86 

0.01 

1 

21 

10163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

22 

10355 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

1 

22 

10355 

A 

1 

20 

83 

1.85 

0.36 

1.24 

0.12 

1 

22 

10355 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1 

22 

10355 

C 

0 

3 

13 

0.82 

0.76 

1.17 

-0.23 

1 

22 

10355 

D 

0 

1 

4 

3.01 

0.00 

6.93 

0.16 

1 

23 

30756 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.02 

1 

23 

30756 

A 

1 

11 

65 

1.72 

0.64 

1.47 

0.33 

1 

23 

30756 

B 

0 

2 

12 

-0.38 

0.87 

0.54 

-0.33 

1 

23 

30756 

C 

0 

1 

6 

2.21 

0.00 

5.12 

0.13 

1 

23 

30756 

D 

0 

3 

18 

0.38 

0.20 

0.85 

-0.22 

1 

24 

10122 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

1 

24 

10122 

A 

1 

12 

50 

1.72 

0.42 

0.87 

0.54 

1 

24 

10122 

B 

0 

5 

21 

-1.17 

0.44 

0.19 

-0.65 

1 

24 

10122 

C 

0 

2 

8 

0.69 

0.22 

0.90 

-0.03 

1 

24 

10122 

D 

0 

5 

21 

0.88 

0.46 

1.59 

0.01 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1 

25 

10314 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

1 

25 

10314 

A 

1 

12 

50 

2.29 

0.55 

1.15 

0.45 

1 

25 

10314 

B 

0 

3 

13 

1.38 

0.31 

1.52 

-0.03 

1 

25 

10314 

C 

0 

3 

13 

0.06 

0.58 

0.51 

-0.33 

1 

25 

10314 

D 

0 

6 

25 

0.82 

0.58 

2.64 

-0.24 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

1 

1MD28 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

2 

1 

1MD28 

A 

1 

69 

91 

1.87 

0.13 

0.93 

0.35 

2 

1 

1MD28 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

1 

1MD28 

C 

0 

7 

9 

0.55 

0.22 

0.52 

-0.35 

2 

1 

1MD28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

2 

1MD229 

* 

-1 

1748 

92 

1.52 

0.03 

0.00 

-0.02 

2 

2 

1MD229 

A 

1 

113 

77 

1.86 

0.10 

0.95 

0.38 

2 

2 

1MD229 

B 

0 

24 

16 

1.06 

0.17 

1.06 

-0.21 

2 

2 

1MD229 

C 

0 

9 

6 

0.06 

0.58 

1.26 

-0.34 

2 

2 

1MD229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

3 

1MD24 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

2 

3 

1MD24 

A 

1 

47 

67 

2.60 

0.15 

0.84 

0.54 

2 

3 

1MD24 

B 

0 

17 

24 

1.30 

0.18 

0.67 

-0.44 

2 

3 

1MD24 

C 

0 

6 

9 

1.26 

0.39 

0.68 

-0.25 

2 

3 

1MD24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

4 

10431 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

2 

4 

10431 

A 

1 

20 

91 

1.16 

0.32 

1.07 

0.54 

2 

4 

10431 

B 

0 

1 

5 

0.46 

0.00 

1.04 

-0.04 

2 

4 

10431 

C 

0 

1 

5 

-5.21 

0.00 

0.00 

-0.70 

2 

4 

10431 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

5 

30701 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.07 

2 

5 

30701 

A 

1 

18 

86 

0.90 

0.25 

0.88 

0.52 

2 

5 

30701 

B 

0 

1 

5 

-0.97 

0.00 

0.30 

-0.33 

2 

5 

30701 

C 

0 

2 

10 

-0.65 

0.09 

0.41 

-0.38 

2 

5 

30701 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

6 

30421 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

2 

6 

30421 

A 

1 

20 

83 

1.85 

0.40 

0.86 

0.47 

2 

6 

30421 

B 

0 

1 

4 

0.27 

0.00 

0.80 

-0.14 

2 

6 

30421 

C 

0 

2 

8 

-0.57 

0.17 

0.35 

-0.34 

2 

6 

30421 

D 

0 

1 

4 

-0.92 

0.00 

0.24 

-0.27 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

7 

30422 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.05 

2 

7 

30422 

A 

1 

18 

72 

1.16 

0.36 

1.10 

0.30 

2 

7 

30422 

B 

0 

4 

16 

0.33 

1.15 

3.41 

-0.15 

2 

7 

30422 

C 

0 

1 

4 

-0.45 

0.00 

0.45 

-0.17 

2 

7 

30422 

D 

0 

2 

8 

-0.02 

0.15 

0.69 

-0.17 

2 

8 

30707 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

0.00 

2 

8 

30707 

A 

1 

17 

74 

2.39 

0.38 

0.89 

0.62 

2 

8 

30707 

B 

0 

2 

9 

-2.80 

2.41 

0.22 

-0.62 

2 

8 

30707 

C 

0 

4 

17 

0.34 

0.53 

0.61 

-0.26 

2 

8 

30707 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

9 

1G25 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

2 

9 

1G25 

A 

1 

47 

64 

1.94 

0.15 

1.04 

0.41 

2 

9 

1G25 

B 

0 

25 

34 

1.00 

0.21 

1.01 

-0.38 

2 

9 

1G25 

C 

0 

1 

1 

0.35 

0.00 

0.33 

-0.13 

2 

9 

1G25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

10 

31020 

* 

-1 

1869 

99 

1.52 

0.03 

0.00 

-0.01 

2 

10 

31020 

A 

1 

12 

48 

2.83 

0.47 

1.32 

0.62 

2 

10 

31020 

B 

0 

2 

8 

0.34 

0.26 

0.29 

-0.22 

2 

10 

31020 

C 

0 

8 

32 

1.22 

0.41 

1.13 

-0.17 

2 

10 

31020 

D 

0 

3 

12 

-0.88 

0.53 

0.11 

-0.52 

2 

11 

10A48 

* 

-1 

1814 

96 

1.53 

0.03 

0.00 

0.01 

2 

11 

10A48 

A 

1 

67 

84 

1.68 

0.12 

0.85 

0.46 

2 

11 

10A48 

B 

0 

5 

6 

0.14 

0.34 

0.49 

-0.31 

2 

11 

10A48 

C 

0 

8 

10 

0.46 

0.29 

0.69 

-0.31 

2 

11 

10A48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

12 

10A26 

* 

-1 

1807 

95 

1.51 

0.03 

0.00 

-0.06 

2 

12 

10A26 

A 

1 

73 

84 

2.14 

0.12 

0.90 

0.44 

2 

12 

10A26 

B 

0 

7 

8 

1.00 

0.22 

0.65 

-0.26 

2 

12 

10A26 

C 

0 

7 

8 

0.73 

0.27 

0.55 

-0.33 

2 

12 

10A26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

13 

1NBT615 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

2 

13 

1NBT615 

A 

1 

59 

81 

2.19 

0.14 

0.83 

0.49 

2 

13 

1NBT615 

B 

0 

10 

14 

0.48 

0.20 

0.40 

-0.50 

2 

13 

1NBT615 

C 

0 

4 

5 

1.45 

0.05 

0.91 

-0.10 

2 

13 

1NBT615 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

14 

10174 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.09 

2 

14 

10174 

A 

1 

11 

46 

1.14 

0.48 

1.82 

0.36 

2 

14 

10174 

B 

0 

6 

25 

0.36 

0.50 

1.53 

-0.03 

2 

14 

10174 

C 

0 

3 

13 

0.20 

0.34 

0.69 

-0.06 

2 

14 

10174 

D 

0 

4 

17 

-1.05 

1.41 

0.81 

-0.39 

2 

15 

1NBT515 

* 

-1 

1806 

95 

1.51 

0.03 

0.00 

-0.06 

2 

15 

1NBT515 

A 

1 

61 

69 

2.17 

0.14 

1.02 

0.36 

2 

15 

1NBT515 

B 

0 

18 

20 

1.57 

0.22 

1.40 

-0.16 

2 

15 

1NBT515 

C 

0 

9 

10 

0.81 

0.18 

0.48 

-0.34 

2 

15 

1NBT515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

16 

1NBT639 

* 

-1 

1745 

92 

1.51 

0.03 

0.00 

-0.03 

2 

16 

1NBT639 

A 

1 

89 

60 

2.02 

0.12 

1.06 

0.38 

2 

16 

1NBT639 

B 

0 

25 

17 

1.18 

0.21 

1.13 

-0.20 

2 

16 

1NBT639 

C 

0 

35 

23 

1.15 

0.15 

0.98 

-0.26 

2 

16 

1NBT639 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

17 

10157 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

2 

17 

10157 

A 

1 

11 

46 

1.52 

0.44 

2.53 

0.15 

2 

17 

10157 

B 

0 

3 

13 

1.47 

0.60 

1.57 

0.04 

2 

17 

10157 

C 

0 

3 

13 

0.58 

0.59 

0.63 

-0.25 

2 

17 

10157 

D 

0 

7 

29 

1.31 

0.35 

1.35 

-0.02 

2 

18 

1MD314 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

2 

18 

1MD314 

A 

1 

57 

81 

2.22 

0.17 

0.89 

0.40 

2 

18 

1MD314 

B 

0 

8 

11 

1.30 

0.50 

2.26 

-0.17 

2 

18 

1MD314 

C 

0 

5 

7 

0.00 

0.25 

0.28 

-0.40 

2 

18 

1MD314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS First Grade Math Measure Development 


94 

Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

19 

10201 

* 

-1 

1726 

91 

1.50 

0.03 

0.00 

-0.05 

2 

19 

10201 

A 

1 

158 

94 

1.85 

0.10 

0.93 

0.33 

2 

19 

10201 

B 

0 

5 

3 

-0.17 

0.37 

0.39 

-0.26 

2 

19 

10201 

C 

0 

5 

3 

0.30 

0.37 

0.57 

-0.20 

2 

19 

10201 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

20 

10081 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

2 

20 

10081 

A 

1 

21 

88 

1.31 

0.30 

1.24 

0.29 

2 

20 

10081 

B 

0 

1 

4 

1.32 

0.00 

2.21 

0.02 

2 

20 

10081 

C 

0 

1 

4 

-0.91 

0.00 

0.24 

-0.32 

2 

20 

10081 

D 

0 

1 

4 

-0.08 

0.00 

0.55 

-0.19 

2 

21 

10213 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

2 

21 

10213 

A 

1 

19 

83 

2.09 

0.41 

0.86 

0.49 

2 

21 

10213 

B 

0 

1 

4 

1.04 

0.00 

1.48 

-0.07 

2 

21 

10213 

C 

0 

2 

9 

-0.68 

0.42 

0.29 

-0.40 

2 

21 

10213 

D 

0 

1 

4 

-0.79 

0.00 

0.24 

-0.29 

2 

22 

10292 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

2 

22 

10292 

A 

1 

19 

79 

1.48 

0.35 

1.31 

0.22 

2 

22 

10292 

B 

0 

4 

17 

0.67 

0.65 

1.81 

-0.20 

2 

22 

10292 

C 

0 

1 

4 

0.84 

0.00 

1.12 

-0.07 

2 

22 

10292 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

23 

10019 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.05 

2 

23 

10019 

A 

1 

14 

61 

1.31 

0.34 

0.93 

0.37 

2 

23 

10019 

B 

0 

4 

17 

0.46 

1.19 

7.27 

-0.14 

2 

23 

10019 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

2 

23 

10019 

D 

0 

5 

22 

0.06 

0.15 

0.60 

-0.31 

2 

24 

1NBT314 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.06 

2 

24 

1NBT314 

A 

1 

52 

70 

2.15 

0.17 

1.11 

0.33 

2 

24 

1NBT314 

B 

0 

17 

23 

1.38 

0.20 

1.01 

-0.25 

2 

24 

1NBT314 

C 

0 

5 

7 

1.19 

0.20 

0.69 

-0.17 

2 

24 

1NBT314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

2 

25 

1NBT311 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

2 

25 

1NBT311 

A 

1 

45 

63 

2.42 

0.14 

0.84 

0.57 

2 

25 

1NBT311 

B 

0 

21 

29 

1.27 

0.19 

0.86 

-0.39 

2 

25 

1NBT311 

C 

0 

6 

8 

0.70 

0.30 

0.40 

-0.34 

2 

25 

1NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS First Grade Math Measure Development 


96 

Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

1 

1MD227 

* 

-1 

1823 

96 

1.52 

0.03 

0.00 

-0.03 

3 

1 

1MD227 

A 

1 

65 

92 

1.86 

0.11 

0.94 

0.34 

3 

1 

1MD227 

B 

0 

3 

4 

0.75 

0.14 

0.49 

-0.24 

3 

1 

1MD227 

C 

0 

3 

4 

0.76 

0.38 

0.55 

-0.24 

3 

1 

1MD227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

2 

1MD13 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

3 

2 

1MD13 

A 

1 

61 

79 

2.04 

0.13 

0.81 

0.60 

3 

2 

1MD13 

B 

0 

8 

10 

0.30 

0.40 

0.59 

-0.38 

3 

2 

1MD13 

C 

0 

8 

10 

0.12 

0.14 

0.34 

-0.43 

3 

2 

1MD13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

3 

1MD18 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

3 

3 

1MD18 

A 

1 

37 

49 

2.27 

0.19 

0.96 

0.46 

3 

3 

1MD18 

B 

0 

7 

9 

1.45 

0.35 

1.07 

-0.09 

3 

3 

1MD18 

C 

0 

32 

42 

1.22 

0.13 

0.81 

-0.42 

3 

3 

1MD18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

4 

1G116 

* 

-1 

1746 

92 

1.50 

0.03 

0.00 

-0.06 

3 

4 

1G116 

A 

1 

143 

97 

1.83 

0.11 

1.06 

0.13 

3 

4 

1G116 

B 

0 

4 

3 

1.01 

0.17 

1.00 

-0.10 

3 

4 

1G116 

C 

0 

1 

1 

0.20 

0.00 

0.42 

-0.10 

3 

4 

1G116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

5 

30746 

* 

-1 

1866 

99 

1.52 

0.03 

0.00 

-0.02 

3 

5 

30746 

A 

1 

26 

93 

1.88 

0.30 

0.85 

0.42 

3 

5 

30746 

B 

0 

1 

4 

-0.31 

0.00 

0.37 

-0.24 

3 

5 

30746 

C 

0 

1 

4 

-1.11 

0.00 

0.17 

-0.34 

3 

5 

30746 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

6 

30598 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

3 

6 

30598 

A 

1 

20 

87 

1.85 

0.38 

1.16 

0.15 

3 

6 

30598 

B 

0 

2 

9 

0.97 

1.76 

3.25 

-0.15 

3 

6 

30598 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

6 

30598 

D 

0 

1 

4 

1.37 

0.00 

1.61 

-0.05 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

7 

31180 

* 

-1 

1866 

99 

1.53 

0.03 

0.00 

0.01 

3 

7 

31180 

A 

1 

23 

82 

1.62 

0.24 

1.05 

0.28 

3 

7 

31180 

B 

0 

3 

11 

0.64 

0.67 

0.91 

-0.24 

3 

7 

31180 

C 

0 

1 

4 

2.39 

0.00 

3.74 

0.15 

3 

7 

31180 

D 

0 

1 

4 

-0.52 

0.00 

0.20 

-0.32 

3 

8 

30413 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

3 

8 

30413 

A 

1 

17 

71 

1.63 

0.33 

1.16 

0.44 

3 

8 

30413 

B 

0 

1 

4 

2.25 

0.00 

3.40 

0.13 

3 

8 

30413 

C 

0 

3 

13 

0.57 

0.18 

0.66 

-0.12 

3 

8 

30413 

D 

0 

3 

13 

-1.55 

1.86 

0.52 

-0.56 

3 

9 

30519 

* 

-1 

1879 

99 

1.52 

0.03 

0.00 

-0.01 

3 

9 

30519 

A 

1 

9 

60 

2.51 

0.55 

0.85 

0.65 

3 

9 

30519 

B 

0 

4 

27 

0.28 

0.56 

0.64 

-0.47 

3 

9 

30519 

C 

0 

1 

7 

-0.11 

0.00 

0.28 

-0.27 

3 

9 

30519 

D 

0 

1 

7 

0.55 

0.00 

0.54 

-0.17 

3 

10 

1G234 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

3 

10 

1G234 

A 

1 

35 

49 

2.34 

0.19 

1.01 

0.42 

3 

10 

1G234 

B 

0 

6 

8 

1.90 

0.48 

1.81 

0.02 

3 

10 

1G234 

C 

0 

30 

42 

1.23 

0.19 

1.08 

-0.43 

3 

10 

1G234 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

11 

10059 

* 

-1 

1716 

91 

1.51 

0.03 

0.00 

-0.04 

3 

11 

10059 

A 

1 

150 

84 

1.94 

0.10 

0.93 

0.42 

3 

11 

10059 

B 

0 

13 

7 

-0.19 

0.32 

0.40 

-0.39 

3 

11 

10059 

C 

0 

14 

8 

0.99 

0.24 

1.16 

-0.15 

3 

11 

10059 

D 

0 

1 

1 

-0.77 

0.00 

0.14 

-0.14 

3 

12 

1NBT510 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

3 

12 

1NBT510 

A 

1 

58 

83 

1.88 

0.12 

0.98 

0.25 

3 

12 

1NBT510 

B 

0 

4 

6 

0.70 

0.30 

0.49 

-0.30 

3 

12 

1NBT510 

C 

0 

8 

11 

1.60 

0.30 

1.44 

-0.07 

3 

12 

1NBT510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

13 

10A811 

* 

-1 

1739 

92 

1.51 

0.03 

0.00 

-0.03 

3 

13 

10A811 

A 

1 

120 

77 

1.79 

0.09 

1.01 

0.25 

3 

13 

10A811 

B 

0 

25 

16 

1.05 

0.15 

0.94 

-0.25 

3 

13 

10A811 

C 

0 

10 

6 

1.41 

0.52 

3.37 

-0.06 

3 

13 

10A811 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

14 

10171 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

3 

14 

10171 

A 

1 

15 

63 

2.28 

0.44 

1.03 

0.51 

3 

14 

10171 

B 

0 

1 

4 

0.97 

0.00 

0.85 

-0.07 

3 

14 

10171 

C 

0 

4 

17 

0.87 

0.36 

0.93 

-0.18 

3 

14 

10171 

D 

0 

4 

17 

-0.13 

0.95 

0.84 

-0.44 

3 

15 

10130 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

3 

15 

10130 

A 

1 

11 

50 

2.10 

0.32 

0.47 

0.76 

3 

15 

10130 

B 

0 

2 

9 

0.58 

0.78 

1.09 

-0.05 

3 

15 

10130 

C 

0 

5 

23 

-0.54 

0.30 

0.32 

-0.45 

3 

15 

10130 

D 

0 

4 

18 

-0.74 

0.84 

0.40 

-0.45 

3 

16 

10A22 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

3 

16 

10A22 

A 

1 

43 

59 

1.86 

0.17 

1.28 

0.29 

3 

16 

10A22 

B 

0 

8 

11 

0.78 

0.42 

0.75 

-0.26 

3 

16 

10A22 

C 

0 

22 

30 

1.37 

0.22 

1.43 

-0.13 

3 

16 

10A22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

17 

1NBT59 

* 

-1 

1806 

95 

1.51 

0.03 

0.00 

-0.06 

3 

17 

1NBT59 

A 

1 

49 

56 

2.38 

0.15 

0.86 

0.49 

3 

17 

1NBT59 

B 

0 

31 

35 

1.33 

0.15 

0.88 

-0.39 

3 

17 

1NBT59 

C 

0 

8 

9 

1.23 

0.38 

0.95 

-0.20 

3 

17 

1NBT59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

18 

1MD327 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

3 

18 

1MD327 

A 

1 

67 

78 

1.75 

0.14 

0.90 

0.44 

3 

18 

1MD327 

B 

0 

15 

17 

0.39 

0.26 

0.81 

-0.42 

3 

18 

1MD327 

C 

0 

4 

5 

0.85 

0.21 

0.80 

-0.12 

3 

18 

1MD327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

19 

10146 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

3 

19 

10146 

A 

1 

20 

91 

1.65 

0.30 

0.85 

0.49 

3 

19 

10146 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

19 

10146 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

19 

10146 

D 

0 

2 

9 

-0.86 

0.35 

0.23 

-0.49 

3 

20 

10084 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

3 

20 

10084 

A 

1 

22 

92 

1.69 

0.30 

1.01 

0.23 

3 

20 

10084 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

20 

10084 

C 

0 

2 

8 

0.56 

0.73 

0.87 

-0.23 

3 

20 

10084 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

21 

10271 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

3 

21 

10271 

A 

1 

18 

75 

1.50 

0.45 

1.09 

0.45 

3 

21 

10271 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

21 

10271 

C 

0 

6 

25 

-0.40 

0.15 

0.55 

-0.45 

3 

21 

10271 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

22 

10219 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.05 

3 

22 

10219 

A 

1 

17 

74 

1.20 

0.33 

0.96 

0.30 

3 

22 

10219 

B 

0 

2 

9 

2.16 

0.61 

6.11 

0.27 

3 

22 

10219 

C 

0 

4 

17 

-0.72 

0.22 

0.30 

-0.55 

3 

22 

10219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

3 

23 

10142 

* 

-1 

1721 

91 

1.50 

0.03 

0.00 

-0.05 

3 

23 

10142 

A 

1 

134 

77 

2.08 

0.10 

1.03 

0.48 

3 

23 

10142 

B 

0 

18 

10 

0.64 

0.18 

0.61 

-0.31 

3 

23 

10142 

C 

0 

20 

12 

0.70 

0.22 

0.75 

-0.31 

3 

23 

10142 

D 

0 

1 

1 

0.30 

0.00 

0.33 

-0.09 

3 

24 

30606 

* 

-1 

1878 

99 

1.53 

0.03 

0.00 

0.00 

3 

24 

30606 

A 

1 

10 

63 

2.09 

0.38 

0.77 

0.55 

3 

24 

30606 

B 

0 

1 

6 

0.24 

0.00 

0.34 

-0.24 

3 

24 

30606 

C 

0 

3 

19 

1.02 

0.98 

1.36 

-0.17 

3 

24 

30606 

D 

0 

2 

13 

0.00 

0.26 

0.27 

-0.42 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

3 

25 

10044 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

3 

25 

10044 

A 

1 

11 

50 

2.83 

0.46 

0.56 

0.75 

3 

25 

10044 

B 

0 

2 

9 

-0.37 

0.41 

0.28 

-0.29 

3 

25 

10044 

C 

0 

3 

14 

0.58 

0.28 

0.71 

-0.16 

3 

25 

10044 

D 

0 

6 

27 

-0.30 

0.56 

0.52 

-0.53 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

1 

1MD131 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

4 

1 

1MD131 

A 

1 

71 

89 

1.82 

0.13 

0.91 

0.40 

4 

1 

1MD131 

B 

0 

7 

9 

0.31 

0.39 

0.63 

-0.35 

4 

1 

1MD131 

C 

0 

2 

3 

0.33 

0.59 

0.51 

-0.18 

4 

1 

1MD131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

2 

1MD113 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

4 

2 

1MD113 

A 

1 

61 

79 

1.92 

0.14 

0.94 

0.41 

4 

2 

1MD113 

B 

0 

4 

5 

1.07 

0.27 

0.92 

-0.11 

4 

2 

1MD113 

C 

0 

12 

16 

0.54 

0.39 

1.02 

-0.39 

4 

2 

1MD113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

3 

1MD232 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

4 

3 

1MD232 

A 

1 

46 

48 

2.26 

0.17 

1.14 

0.36 

4 

3 

1MD232 

B 

0 

15 

16 

1.30 

0.20 

0.76 

-0.23 

4 

3 

1MD232 

C 

0 

34 

36 

1.56 

0.15 

1.09 

-0.21 

4 

3 

1MD232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

4 

10418 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

4 

4 

10418 

A 

1 

22 

96 

1.50 

0.30 

0.86 

0.36 

4 

4 

10418 

B 

0 

1 

4 

-1.11 

0.00 

0.18 

-0.36 

4 

4 

10418 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

4 

10418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

5 

31193 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.04 

4 

5 

31193 

A 

1 

19 

86 

1.19 

0.33 

0.75 

0.31 

4 

5 

31193 

B 

0 

1 

5 

-0.94 

0.00 

0.31 

-0.26 

4 

5 

31193 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

5 

31193 

D 

0 

2 

9 

0.01 

2.70 

5.88 

-0.19 

4 

6 

1G23 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

4 

6 

1G23 

A 

1 

76 

88 

1.57 

0.14 

1.00 

0.24 

4 

6 

1G23 

B 

0 

9 

10 

0.93 

0.29 

1.29 

-0.16 

4 

6 

1G23 

C 

0 

1 

1 

-1.44 

0.00 

0.09 

-0.27 

4 

6 

1G23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

7 

10446 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

4 

7 

10446 

A 

1 

19 

83 

2.07 

0.30 

0.65 

0.62 

4 

7 

10446 

B 

0 

3 

13 

-0.33 

0.73 

0.41 

-0.49 

4 

7 

10446 

C 

0 

1 

4 

-0.73 

0.00 

0.19 

-0.33 

4 

7 

10446 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

8 

30725 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.03 

4 

8 

30725 

A 

1 

17 

77 

2.56 

0.41 

0.90 

0.55 

4 

8 

30725 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

8 

30725 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

8 

30725 

D 

0 

5 

23 

-0.45 

1.32 

1.20 

-0.55 

4 

9 

1G334 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

4 

9 

1G334 

A 

1 

48 

66 

1.85 

0.15 

1.10 

0.32 

4 

9 

1G334 

B 

0 

17 

23 

0.96 

0.23 

0.95 

-0.31 

4 

9 

1G334 

C 

0 

8 

11 

1.42 

0.54 

2.00 

-0.06 

4 

9 

1G334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

10 

30735 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.06 

4 

10 

30735 

A 

1 

5 

28 

1.76 

0.34 

0.49 

0.63 

4 

10 

30735 

B 

0 

5 

28 

-0.13 

0.36 

0.47 

-0.41 

4 

10 

30735 

C 

0 

2 

11 

-0.23 

0.99 

0.51 

-0.27 

4 

10 

30735 

D 

0 

6 

33 

0.56 

0.41 

1.10 

-0.03 

4 

11 

10077 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.04 

4 

11 

10077 

A 

1 

20 

83 

2.59 

0.32 

0.48 

0.71 

4 

11 

10077 

B 

0 

1 

4 

-0.25 

0.00 

0.31 

-0.25 

4 

11 

10077 

C 

0 

1 

4 

-0.20 

0.00 

0.32 

-0.24 

4 

11 

10077 

D 

0 

2 

8 

-1.79 

0.90 

0.09 

-0.60 

4 

12 

1NBT520 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

4 

12 

1NBT520 

A 

1 

58 

79 

1.85 

0.13 

0.88 

0.45 

4 

12 

1NBT520 

B 

0 

15 

21 

0.60 

0.29 

0.88 

-0.45 

4 

12 

1NBT520 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

12 

1NBT520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

13 

10097 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

4 

13 

10097 

A 

1 

17 

71 

1.89 

0.35 

1.05 

0.51 

4 

13 

10097 

B 

0 

4 

17 

0.18 

0.46 

0.63 

-0.38 

4 

13 

10097 

C 

0 

3 

13 

0.34 

0.49 

0.69 

-0.28 

4 

13 

10097 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

14 

10A217 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

4 

14 

10A217 

A 

1 

52 

72 

2.31 

0.14 

0.88 

0.54 

4 

14 

10A217 

B 

0 

9 

13 

0.67 

0.25 

0.46 

-0.44 

4 

14 

10A217 

C 

0 

11 

15 

1.27 

0.23 

0.80 

-0.26 

4 

14 

10A217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

15 

1NBT612 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

4 

15 

1NBT612 

A 

1 

50 

69 

2.17 

0.15 

1.17 

0.31 

4 

15 

1NBT612 

B 

0 

13 

18 

1.65 

0.33 

1.64 

-0.13 

4 

15 

1NBT612 

C 

0 

9 

13 

1.13 

0.24 

0.68 

-0.28 

4 

15 

1NBT612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

16 

1NBT535 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

4 

16 

1NBT535 

A 

1 

45 

59 

2.10 

0.17 

1.03 

0.39 

4 

16 

1NBT535 

B 

0 

9 

12 

1.06 

0.27 

0.77 

-0.23 

4 

16 

1NBT535 

C 

0 

22 

29 

1.32 

0.15 

0.95 

-0.25 

4 

16 

1NBT535 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

17 

1NBT513 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

4 

17 

1NBT513 

A 

1 

38 

54 

2.34 

0.20 

1.08 

0.45 

4 

17 

1NBT513 

B 

0 

17 

24 

0.97 

0.22 

0.66 

-0.40 

4 

17 

1NBT513 

C 

0 

16 

23 

1.55 

0.21 

1.10 

-0.13 

4 

17 

1NBT513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

18 

1MD312 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

4 

18 

1MD312 

A 

1 

67 

83 

1.64 

0.13 

0.95 

0.36 

4 

18 

1MD312 

B 

0 

12 

15 

0.60 

0.23 

0.76 

-0.33 

4 

18 

1MD312 

C 

0 

2 

2 

0.75 

1.01 

1.07 

-0.10 

4 

18 

1MD312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

19 

10338 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

-0.02 

4 

19 

10338 

A 

1 

20 

95 

1.88 

0.25 

0.98 

0.27 

4 

19 

10338 

B 

0 

1 

5 

0.50 

0.00 

0.42 

-0.27 

4 

19 

10338 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

19 

10338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

20 

10349 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.06 

4 

20 

10349 

A 

1 

17 

81 

1.01 

0.42 

1.07 

0.36 

4 

20 

10349 

B 

0 

1 

5 

-0.40 

0.00 

0.65 

-0.15 

4 

20 

10349 

C 

0 

3 

14 

-0.53 

0.34 

0.63 

-0.31 

4 

20 

10349 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

21 

1NBT51 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

4 

21 

1NBT51 

A 

1 

70 

86 

1.53 

0.13 

1.02 

0.15 

4 

21 

1NBT51 

B 

0 

6 

7 

1.22 

0.46 

1.71 

-0.06 

4 

21 

1NBT51 

C 

0 

5 

6 

0.88 

0.62 

1.77 

-0.14 

4 

21 

1NBT51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

22 

10276 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

4 

22 

10276 

A 

1 

19 

83 

2.22 

0.34 

0.69 

0.60 

4 

22 

10276 

B 

0 

2 

9 

0.12 

0.38 

0.47 

-0.30 

4 

22 

10276 

C 

0 

2 

9 

-0.95 

0.77 

0.20 

-0.50 

4 

22 

10276 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

23 

10182 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

4 

23 

10182 

A 

1 

14 

64 

1.74 

0.45 

0.97 

0.54 

4 

23 

10182 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

4 

23 

10182 

C 

0 

4 

18 

0.33 

0.21 

0.76 

-0.22 

4 

23 

10182 

D 

0 

4 

18 

-0.44 

0.39 

0.42 

-0.45 

4 

24 

10385 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.01 

4 

24 

10385 

A 

1 

13 

62 

2.18 

0.26 

0.60 

0.72 

4 

24 

10385 

B 

0 

6 

29 

0.69 

0.21 

0.58 

-0.36 

4 

24 

10385 

C 

0 

1 

5 

-0.35 

0.00 

0.19 

-0.31 

4 

24 

10385 

D 

0 

1 

5 

-1.85 

0.00 

0.04 

-0.56 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

4 

25 

1NBT21 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

4 

25 

1NBT21 

A 

1 

44 

57 

2.33 

0.15 

0.81 

0.63 

4 

25 

1NBT21 

B 

0 

14 

18 

0.72 

0.30 

0.68 

-0.36 

4 

25 

1NBT21 

C 

0 

19 

25 

0.80 

0.16 

0.57 

-0.40 

4 

25 

1NBT21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

1 

1MD14 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

5 

1 

1MD14 

A 

1 

65 

93 

2.26 

0.14 

0.99 

0.29 

5 

1 

1MD14 

B 

0 

3 

4 

0.95 

0.33 

0.53 

-0.23 

5 

1 

1MD14 

C 

0 

2 

3 

1.06 

0.49 

0.59 

-0.17 

5 

1 

1MD14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

2 

1MD221 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

5 

2 

1MD221 

A 

1 

62 

82 

1.96 

0.14 

0.94 

0.41 

5 

2 

1MD221 

B 

0 

5 

7 

0.91 

0.25 

0.68 

-0.20 

5 

2 

1MD221 

C 

0 

9 

12 

0.74 

0.18 

0.58 

-0.34 

5 

2 

1MD221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

3 

1MD118 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

5 

3 

1MD118 

A 

1 

47 

67 

2.52 

0.16 

0.94 

0.44 

5 

3 

1MD118 

B 

0 

15 

21 

1.69 

0.26 

1.18 

-0.22 

5 

3 

1MD118 

C 

0 

8 

11 

1.03 

0.25 

0.48 

-0.36 

5 

3 

1MD118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

4 

30403 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.02 

5 

4 

30403 

A 

1 

19 

95 

1.30 

0.28 

0.97 

0.30 

5 

4 

30403 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

4 

30403 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

4 

30403 

D 

0 

1 

5 

-0.33 

0.00 

0.37 

-0.30 

5 

5 

10422 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

5 

5 

10422 

A 

1 

21 

91 

1.02 

0.25 

1.09 

0.06 

5 

5 

10422 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

5 

10422 

C 

0 

2 

9 

0.80 

0.21 

1.21 

-0.06 

5 

5 

10422 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

6 

1G115 

* 

-1 

1818 

96 

1.53 

0.03 

0.00 

0.02 

5 

6 

1G115 

A 

1 

66 

87 

1.63 

0.14 

0.82 

0.47 

5 

6 

1G115 

B 

0 

5 

7 

-0.26 

0.55 

0.56 

-0.35 

5 

6 

1G115 

C 

0 

5 

7 

0.02 

0.34 

0.51 

-0.29 

5 

6 

1G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

7 

30117 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

5 

7 

30117 

A 

1 

18 

75 

1.12 

0.31 

1.22 

0.29 

5 

7 

30117 

B 

0 

2 

8 

0.69 

0.22 

1.14 

-0.06 

5 

7 

30117 

C 

0 

2 

8 

-0.16 

0.78 

0.63 

-0.27 

5 

7 

30117 

D 

0 

2 

8 

0.38 

0.52 

0.93 

-0.13 

5 

8 

30743 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.04 

5 

8 

30743 

A 

1 

12 

63 

1.52 

0.50 

1.10 

0.45 

5 

8 

30743 

B 

0 

4 

21 

0.21 

0.50 

1.00 

-0.22 

5 

8 

30743 

C 

0 

1 

5 

0.04 

0.00 

0.58 

-0.13 

5 

8 

30743 

D 

0 

2 

11 

-0.68 

1.67 

0.78 

-0.33 

5 

9 

1G336 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

5 

9 

1G336 

A 

1 

53 

62 

1.86 

0.16 

0.93 

0.42 

5 

9 

1G336 

B 

0 

13 

15 

0.67 

0.28 

0.81 

-0.28 

5 

9 

1G336 

C 

0 

20 

23 

0.95 

0.24 

1.27 

-0.24 

5 

9 

1G336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

10 

1G39 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

5 

10 

1G39 

A 

1 

39 

52 

2.16 

0.20 

1.24 

0.22 

5 

10 

1G39 

B 

0 

20 

27 

1.60 

0.20 

1.15 

-0.17 

5 

10 

1G39 

C 

0 

16 

21 

1.74 

0.26 

1.54 

-0.08 

5 

10 

1G39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

11 

10A412 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

5 

11 

10A412 

A 

1 

64 

88 

2.10 

0.14 

0.87 

0.43 

5 

11 

10A412 

B 

0 

4 

5 

0.65 

0.38 

0.51 

-0.26 

5 

11 

10A412 

C 

0 

5 

7 

0.57 

0.30 

0.47 

-0.32 

5 

11 

10A412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

12 

10A23 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

5 

12 

10A23 

A 

1 

62 

81 

2.03 

0.13 

0.73 

0.61 

5 

12 

10A23 

B 

0 

8 

10 

0.44 

0.29 

0.60 

-0.34 

5 

12 

10A23 

C 

0 

7 

9 

-0.22 

0.33 

0.31 

-0.48 

5 

12 

10A23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

13 

10127 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

5 

13 

10127 

A 

1 

15 

68 

1.34 

0.32 

1.33 

0.26 

5 

13 

10127 

B 

0 

3 

14 

0.43 

0.68 

0.96 

-0.25 

5 

13 

10127 

C 

0 

2 

9 

1.77 

0.24 

2.39 

0.17 

5 

13 

10127 

D 

0 

2 

9 

0.04 

0.22 

0.43 

-0.30 

5 

14 

1OA210 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

5 

14 

1OA210 

A 

1 

49 

70 

2.07 

0.18 

1.22 

0.35 

5 

14 

1OA210 

B 

0 

11 

16 

1.29 

0.28 

1.06 

-0.19 

5 

14 

1OA210 

C 

0 

10 

14 

1.08 

0.16 

0.70 

-0.25 

5 

14 

1OA210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

15 

1NBT617 

* 

-1 

1814 

96 

1.53 

0.03 

0.00 

0.01 

5 

15 

1NBT617 

A 

1 

48 

60 

1.75 

0.17 

1.21 

0.33 

5 

15 

1NBT617 

B 

0 

16 

20 

1.17 

0.19 

1.11 

-0.14 

5 

15 

1NBT617 

C 

0 

16 

20 

0.88 

0.19 

0.94 

-0.27 

5 

15 

1NBT617 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

16 

10176 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

5 

16 

10176 

A 

1 

11 

46 

2.20 

0.53 

0.92 

0.59 

5 

16 

10176 

B 

0 

6 

25 

-0.03 

0.59 

0.66 

-0.36 

5 

16 

10176 

C 

0 

2 

8 

1.09 

1.02 

1.79 

0.00 

5 

16 

10176 

D 

0 

5 

21 

-0.13 

0.38 

0.43 

-0.35 

5 

17 

1NBT54 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

5 

17 

1NBT54 

A 

1 

37 

53 

2.10 

0.16 

1.06 

0.38 

5 

17 

1NBT54 

B 

0 

10 

14 

1.65 

0.21 

1.12 

-0.06 

5 

17 

1NBT54 

C 

0 

23 

33 

1.32 

0.12 

0.80 

-0.36 

5 

17 

1NBT54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

18 

1MD315 

* 

-1 

1750 

92 

1.50 

0.03 

0.00 

-0.07 

5 

18 

1MD315 

A 

1 

125 

87 

1.95 

0.10 

1.08 

0.17 

5 

18 

1MD315 

B 

0 

11 

8 

1.07 

0.27 

1.03 

-0.20 

5 

18 

1MD315 

C 

0 

8 

6 

1.80 

0.44 

2.84 

-0.02 

5 

18 

1MD315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

19 

10300 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

5 

19 

10300 

A 

1 

21 

88 

1.55 

0.24 

0.69 

0.74 

5 

19 

10300 

B 

0 

1 

4 

-1.72 

0.00 

0.09 

-0.32 

5 

19 

10300 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

19 

10300 

D 

0 

2 

8 

-2.88 

2.36 

0.29 

-0.65 

5 

20 

10256 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

5 

20 

10256 

A 

1 

19 

83 

0.89 

0.37 

1.45 

0.24 

5 

20 

10256 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

20 

10256 

C 

0 

2 

9 

0.33 

0.87 

1.75 

-0.08 

5 

20 

10256 

D 

0 

2 

9 

-0.40 

0.53 

0.69 

-0.23 

5 

21 

10302 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

5 

21 

10302 

A 

1 

19 

83 

1.74 

0.34 

0.94 

0.48 

5 

21 

10302 

B 

0 

4 

17 

-0.14 

0.27 

0.45 

-0.48 

5 

21 

10302 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

21 

10302 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

5 

22 

10376 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

5 

22 

10376 

A 

1 

18 

75 

1.71 

0.35 

0.66 

0.62 

5 

22 

10376 

B 

0 

2 

8 

-0.22 

0.25 

0.49 

-0.24 

5 

22 

10376 

C 

0 

3 

13 

-0.37 

0.21 

0.43 

-0.33 

5 

22 

10376 

D 

0 

1 

4 

-2.69 

0.00 

0.04 

-0.47 

5 

23 

10017 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

5 

23 

10017 

A 

1 

16 

70 

2.06 

0.35 

0.69 

0.63 

5 

23 

10017 

B 

0 

3 

13 

-0.15 

0.49 

0.46 

-0.36 

5 

23 

10017 

C 

0 

1 

4 

0.37 

0.00 

0.61 

-0.13 

5 

23 

10017 

D 

0 

3 

13 

-0.47 

1.04 

0.55 

-0.43 

5 

24 

10383 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

5 

24 

10383 

A 

1 

12 

50 

1.49 

0.41 

1.02 

0.44 

5 

24 

10383 

B 

0 

7 

29 

0.54 

0.30 

1.04 

-0.16 

5 

24 

10383 

C 

0 

3 

13 

-0.95 

0.72 

0.27 

-0.50 

5 

24 

10383 

D 

0 

2 

8 

1.15 

0.55 

1.71 

0.06 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

5 

25 

1NBT318 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

5 

25 

1NBT318 

A 

1 

43 

61 

2.48 

0.20 

1.15 

0.48 

5 

25 

1NBT318 

B 

0 

19 

27 

1.24 

0.24 

1.10 

-0.32 

5 

25 

1NBT318 

C 

0 

8 

11 

0.82 

0.25 

0.55 

-0.30 

5 

25 

1NBT318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

1 

1MD230 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

6 

1 

1MD230 

A 

1 

64 

90 

1.95 

0.15 

0.98 

0.30 

6 

1 

1MD230 

B 

0 

4 

6 

0.40 

0.52 

0.59 

-0.29 

6 

1 

1MD230 

C 

0 

3 

4 

1.26 

0.44 

1.09 

-0.10 

6 

1 

1MD230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

2 

1MD129 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

6 

2 

1MD129 

A 

1 

58 

82 

2.19 

0.17 

1.00 

0.39 

6 

2 

1MD129 

B 

0 

10 

14 

0.97 

0.34 

1.08 

-0.28 

6 

2 

1MD129 

C 

0 

3 

4 

0.25 

0.20 

0.34 

-0.26 

6 

2 

1MD129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

3 

1MD120 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

6 

3 

1MD120 

A 

1 

37 

51 

1.89 

0.17 

0.96 

0.50 

6 

3 

1MD120 

B 

0 

7 

10 

0.19 

0.38 

0.45 

-0.30 

6 

3 

1MD120 

C 

0 

29 

40 

0.82 

0.20 

1.25 

-0.33 

6 

3 

1MD120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

4 

10408 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

6 

4 

10408 

A 

1 

23 

96 

1.80 

0.35 

1.12 

0.14 

6 

4 

10408 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

4 

10408 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

4 

10408 

D 

0 

1 

4 

0.68 

0.00 

1.12 

-0.14 

6 

5 

1G140 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

6 

5 

1G140 

A 

1 

67 

94 

1.94 

0.14 

0.92 

0.35 

6 

5 

1G140 

B 

0 

1 

1 

-0.69 

0.00 

0.14 

-0.25 

6 

5 

1G140 

C 

0 

3 

4 

0.38 

0.30 

0.45 

-0.26 

6 

5 

1G140 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

6 

30583 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.01 

6 

6 

30583 

A 

1 

16 

84 

1.58 

0.40 

0.98 

0.38 

6 

6 

30583 

B 

0 

1 

5 

0.00 

0.00 

0.51 

-0.20 

6 

6 

30583 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

6 

30583 

D 

0 

2 

11 

-0.04 

0.07 

0.49 

-0.31 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

7 

31018 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.06 

6 

7 

31018 

A 

1 

12 

71 

1.01 

0.37 

1.07 

0.39 

6 

7 

31018 

B 

0 

4 

24 

-0.31 

0.41 

0.65 

-0.46 

6 

7 

31018 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

7 

31018 

D 

0 

1 

6 

1.07 

0.00 

1.93 

0.07 

6 

8 

30114 

* 

-1 

1728 

91 

1.52 

0.03 

0.00 

-0.02 

6 

8 

30114 

A 

1 

128 

77 

1.80 

0.10 

1.00 

0.31 

6 

8 

30114 

B 

0 

8 

5 

0.00 

0.43 

0.48 

-0.30 

6 

8 

30114 

C 

0 

28 

17 

1.27 

0.22 

2.10 

-0.12 

6 

8 

30114 

D 

0 

2 

1 

-0.37 

0.29 

0.20 

-0.18 

6 

9 

10426 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

6 

9 

10426 

A 

1 

13 

59 

2.09 

0.37 

0.78 

0.58 

6 

9 

10426 

B 

0 

5 

23 

0.83 

0.49 

1.11 

-0.15 

6 

9 

10426 

C 

0 

2 

9 

0.52 

0.01 

0.52 

-0.15 

6 

9 

10426 

D 

0 

2 

9 

-2.00 

1.21 

0.08 

-0.63 

6 

10 

1G343 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

6 

10 

1G343 

A 

1 

45 

47 

2.37 

0.18 

1.17 

0.45 

6 

10 

1G343 

B 

0 

6 

6 

1.20 

0.28 

0.63 

-0.16 

6 

10 

1G343 

C 

0 

44 

46 

1.43 

0.11 

0.84 

-0.37 

6 

10 

1G343 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

11 

10060 

* 

-1 

1717 

91 

1.51 

0.03 

0.00 

-0.02 

6 

11 

10060 

A 

1 

148 

84 

1.91 

0.09 

0.89 

0.50 

6 

11 

10060 

B 

0 

13 

7 

0.38 

0.29 

0.79 

-0.28 

6 

11 

10060 

C 

0 

13 

7 

0.10 

0.24 

0.45 

-0.34 

6 

11 

10060 

D 

0 

3 

2 

-0.11 

0.99 

0.54 

-0.18 

6 

12 

10064 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

6 

12 

10064 

A 

1 

16 

73 

1.81 

0.38 

0.71 

0.56 

6 

12 

10064 

B 

0 

2 

9 

0.33 

0.62 

0.83 

-0.18 

6 

12 

10064 

C 

0 

1 

5 

-0.58 

0.00 

0.28 

-0.25 

6 

12 

10064 

D 

0 

3 

14 

-0.44 

0.65 

0.45 

-0.42 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

13 

10A215 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

6 

13 

10A215 

A 

1 

51 

73 

1.88 

0.16 

0.82 

0.55 

6 

13 

10A215 

B 

0 

13 

19 

0.31 

0.28 

0.69 

-0.43 

6 

13 

10A215 

C 

0 

6 

9 

0.34 

0.25 

0.53 

-0.27 

6 

13 

10A215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

14 

10175 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

6 

14 

10175 

A 

1 

14 

61 

1.56 

0.29 

1.12 

0.29 

6 

14 

10175 

B 

0 

3 

13 

0.91 

0.89 

1.27 

-0.14 

6 

14 

10175 

C 

0 

5 

22 

1.26 

0.37 

1.29 

-0.02 

6 

14 

10175 

D 

0 

1 

4 

-0.79 

0.00 

0.13 

-0.40 

6 

15 

10102 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.05 

6 

15 

10102 

A 

1 

17 

71 

2.62 

0.35 

1.14 

0.44 

6 

15 

10102 

B 

0 

5 

21 

1.90 

0.34 

1.60 

-0.09 

6 

15 

10102 

C 

0 

1 

4 

-0.95 

0.00 

0.07 

-0.42 

6 

15 

10102 

D 

0 

1 

4 

-0.85 

0.00 

0.08 

-0.40 

6 

16 

10A214 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

6 

16 

10A214 

A 

1 

47 

67 

2.59 

0.16 

1.00 

0.53 

6 

16 

10A214 

B 

0 

17 

24 

1.22 

0.14 

0.56 

-0.48 

6 

16 

10A214 

C 

0 

6 

9 

1.63 

0.17 

0.76 

-0.15 

6 

16 

10A214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

17 

10187 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

6 

17 

10187 

A 

1 

12 

52 

2.35 

0.51 

2.35 

0.37 

6 

17 

10187 

B 

0 

5 

22 

1.88 

0.45 

2.08 

0.04 

6 

17 

10187 

C 

0 

4 

17 

0.77 

0.88 

1.47 

-0.28 

6 

17 

10187 

D 

0 

2 

9 

-0.03 

0.76 

0.26 

-0.34 

6 

18 

1MD320 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

6 

18 

1MD320 

A 

1 

59 

84 

1.71 

0.15 

0.86 

0.46 

6 

18 

1MD320 

B 

0 

7 

10 

0.33 

0.36 

0.78 

-0.30 

6 

18 

1MD320 

C 

0 

4 

6 

-0.31 

0.50 

0.40 

-0.34 

6 

18 

1MD320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

19 

10311 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.03 

6 

19 

10311 

A 

1 

21 

91 

1.84 

0.46 

1.19 

-0.02 

6 

19 

10311 

B 

0 

1 

4 

0.41 

0.00 

0.96 

-0.15 

6 

19 

10311 

C 

0 

1 

4 

3.50 

0.00 

21.08 

0.17 

6 

19 

10311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

20 

10307 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

6 

20 

10307 

A 

1 

19 

83 

1.11 

0.28 

0.73 

0.58 

6 

20 

10307 

B 

0 

1 

4 

0.37 

0.00 

1.19 

-0.05 

6 

20 

10307 

C 

0 

1 

4 

-1.26 

0.00 

0.23 

-0.30 

6 

20 

10307 

D 

0 

2 

9 

-1.71 

0.79 

0.20 

-0.53 

6 

21 

10109 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.01 

6 

21 

10109 

A 

1 

19 

86 

1.83 

0.34 

1.20 

0.22 

6 

21 

10109 

B 

0 

1 

5 

1.31 

0.00 

1.26 

-0.06 

6 

21 

10109 

C 

0 

1 

5 

0.07 

0.00 

0.36 

-0.26 

6 

21 

10109 

D 

0 

1 

5 

1.47 

0.00 

1.47 

-0.04 

6 

22 

10088 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

6 

22 

10088 

A 

1 

18 

75 

1.44 

0.36 

1.09 

0.33 

6 

22 

10088 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

6 

22 

10088 

C 

0 

3 

13 

1.07 

1.11 

5.16 

-0.02 

6 

22 

10088 

D 

0 

3 

13 

-0.55 

0.26 

0.36 

-0.41 

6 

23 

10113 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

6 

23 

10113 

A 

1 

16 

67 

1.87 

0.37 

0.86 

0.58 

6 

23 

10113 

B 

0 

3 

13 

-0.30 

0.33 

0.40 

-0.38 

6 

23 

10113 

C 

0 

1 

4 

-0.54 

0.00 

0.28 

-0.24 

6 

23 

10113 

D 

0 

4 

17 

0.34 

0.44 

0.96 

-0.27 

6 

24 

1NBT324 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

6 

24 

1NBT324 

A 

1 

43 

59 

1.84 

0.16 

0.95 

0.54 

6 

24 

1NBT324 

B 

0 

12 

16 

0.56 

0.13 

0.59 

-0.28 

6 

24 

1NBT324 

C 

0 

18 

25 

0.52 

0.28 

0.87 

-0.37 

6 

24 

1NBT324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

6 

25 

10140 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

6 

25 

10140 

A 

1 

11 

46 

2.27 

0.37 

0.54 

0.63 

6 

25 

10140 

B 

0 

8 

33 

0.32 

0.31 

0.69 

-0.24 

6 

25 

10140 

C 

0 

3 

13 

-0.21 

0.40 

0.32 

-0.23 

6 

25 

10140 

D 

0 

2 

8 

-1.87 

3.36 

1.48 

-0.45 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

1 

1MD12 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

7 

1 

1MD12 

A 

1 

61 

86 

1.69 

0.15 

0.89 

0.48 

7 

1 

1MD12 

B 

0 

4 

6 

-0.44 

0.50 

0.38 

-0.36 

7 

1 

1MD12 

C 

0 

6 

8 

0.23 

0.14 

0.51 

-0.29 

7 

1 

1MD12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

2 

1MD222 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

7 

2 

1MD222 

A 

1 

58 

79 

1.82 

0.14 

1.14 

0.40 

7 

2 

1MD222 

B 

0 

8 

11 

0.79 

0.34 

0.98 

-0.25 

7 

2 

1MD222 

C 

0 

7 

10 

0.64 

0.35 

0.78 

-0.28 

7 

2 

1MD222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

3 

1MD127 

* 

-1 

1746 

92 

1.50 

0.03 

0.00 

-0.06 

7 

3 

1MD127 

A 

1 

82 

55 

2.10 

0.14 

1.39 

0.26 

7 

3 

1MD127 

B 

0 

22 

15 

0.76 

0.24 

0.87 

-0.33 

7 

3 

1MD127 

C 

0 

44 

30 

1.74 

0.18 

2.03 

-0.03 

7 

3 

1MD127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

4 

30106 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

7 

4 

30106 

A 

1 

21 

91 

1.67 

0.31 

0.40 

0.69 

7 

4 

30106 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

4 

30106 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

4 

30106 

D 

0 

2 

9 

-2.85 

0.36 

0.07 

-0.69 

7 

5 

30518 

* 

-1 

1862 

98 

1.54 

0.03 

0.00 

0.07 

7 

5 

30518 

A 

1 

28 

88 

0.96 

0.26 

0.97 

0.30 

7 

5 

30518 

B 

0 

1 

3 

1.07 

0.00 

2.30 

0.03 

7 

5 

30518 

C 

0 

1 

3 

-1.38 

0.00 

0.20 

-0.28 

7 

5 

30518 

D 

0 

2 

6 

-0.48 

0.19 

0.50 

-0.24 

7 

6 

30709 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.02 

7 

6 

30709 

A 

1 

15 

83 

1.53 

0.44 

1.04 

0.31 

7 

6 

30709 

B 

0 

2 

11 

0.27 

1.09 

1.24 

-0.22 

7 

6 

30709 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

6 

30709 

D 

0 

1 

6 

0.01 

0.00 

0.58 

-0.19 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

7 

1G214 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

7 

7 

1G214 

A 

1 

71 

83 

1.47 

0.15 

1.31 

0.00 

7 

7 

1G214 

B 

0 

14 

16 

1.61 

0.20 

2.19 

0.05 

7 

7 

1G214 

C 

0 

1 

1 

-0.48 

0.00 

0.21 

-0.18 

7 

7 

1G214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

8 

31014 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

7 

8 

31014 

A 

1 

16 

67 

1.40 

0.29 

0.88 

0.50 

7 

8 

31014 

B 

0 

3 

13 

0.11 

0.25 

0.57 

-0.26 

7 

8 

31014 

C 

0 

4 

17 

0.11 

0.76 

1.06 

-0.31 

7 

8 

31014 

D 

0 

1 

4 

-0.18 

0.00 

0.40 

-0.19 

7 

9 

30561 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

7 

9 

30561 

A 

1 

13 

57 

1.83 

0.29 

0.68 

0.71 

7 

9 

30561 

B 

0 

6 

26 

0.08 

0.25 

0.47 

-0.51 

7 

9 

30561 

C 

0 

4 

17 

0.21 

0.21 

0.50 

-0.34 

7 

9 

30561 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

10 

1G311 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

7 

10 

1G311 

A 

1 

34 

48 

2.32 

0.22 

1.34 

0.39 

7 

10 

1G311 

B 

0 

33 

46 

1.47 

0.17 

1.13 

-0.29 

7 

10 

1G311 

C 

0 

4 

6 

0.71 

0.38 

0.42 

-0.23 

7 

10 

1G311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

11 

10071 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

7 

11 

10071 

A 

1 

17 

77 

1.73 

0.43 

1.18 

0.38 

7 

11 

10071 

B 

0 

1 

5 

-0.20 

0.00 

0.41 

-0.21 

7 

11 

10071 

C 

0 

4 

18 

0.36 

0.40 

0.87 

-0.30 

7 

11 

10071 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

12 

10A216 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

7 

12 

10A216 

A 

1 

56 

77 

1.55 

0.15 

1.01 

0.38 

7 

12 

10A216 

B 

0 

14 

19 

0.69 

0.27 

1.10 

-0.25 

7 

12 

10A216 

C 

0 

3 

4 

-0.55 

0.80 

0.40 

-0.32 

7 

12 

10A216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

13 

10066 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

7 

13 

10066 

A 

1 

15 

63 

1.56 

0.38 

1.16 

0.51 

7 

13 

10066 

B 

0 

6 

25 

0.45 

0.44 

1.10 

-0.10 

7 

13 

10066 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

13 

10066 

D 

0 

3 

13 

-2.36 

1.57 

0.32 

-0.62 

7 

14 

10A416 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

7 

14 

10A416 

A 

1 

49 

70 

1.92 

0.13 

1.09 

0.23 

7 

14 

10A416 

B 

0 

5 

7 

1.28 

0.33 

0.91 

-0.16 

7 

14 

10A416 

C 

0 

16 

23 

1.53 

0.18 

1.20 

-0.15 

7 

14 

10A416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

15 

10167 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

7 

15 

10167 

A 

1 

12 

50 

1.97 

0.46 

1.69 

0.64 

7 

15 

10167 

B 

0 

7 

29 

-0.31 

0.36 

0.44 

-0.49 

7 

15 

10167 

C 

0 

4 

17 

-0.24 

0.23 

0.37 

-0.32 

7 

15 

10167 

D 

0 

1 

4 

1.91 

0.00 

2.92 

0.12 

7 

16 

10137 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

7 

16 

10137 

A 

1 

12 

52 

2.19 

0.41 

0.87 

0.54 

7 

16 

10137 

B 

0 

3 

13 

0.62 

0.80 

1.05 

-0.20 

7 

16 

10137 

C 

0 

6 

26 

0.24 

0.54 

0.70 

-0.46 

7 

16 

10137 

D 

0 

2 

9 

1.39 

0.31 

1.22 

0.00 

7 

17 

10173 

* 

-1 

1707 

90 

1.51 

0.03 

0.00 

-0.03 

7 

17 

10173 

A 

1 

93 

50 

2.20 

0.14 

1.06 

0.42 

7 

17 

10173 

B 

0 

48 

26 

1.32 

0.14 

1.23 

-0.16 

7 

17 

10173 

C 

0 

42 

22 

0.89 

0.15 

0.79 

-0.32 

7 

17 

10173 

D 

0 

4 

2 

1.14 

0.32 

0.77 

-0.06 

7 

18 

1MD329 

* 

-1 

1823 

96 

1.52 

0.03 

0.00 

-0.03 

7 

18 

1MD329 

A 

1 

66 

93 

1.84 

0.11 

0.95 

0.30 

7 

18 

1MD329 

B 

0 

2 

3 

0.94 

0.25 

0.60 

-0.16 

7 

18 

1MD329 

C 

0 

3 

4 

0.69 

0.38 

0.52 

-0.25 

7 

18 

1MD329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

19 

10312 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

7 

19 

10312 

A 

1 

20 

87 

1.56 

0.28 

0.52 

0.72 

7 

19 

10312 

B 

0 

1 

4 

-2.04 

0.00 

0.11 

-0.39 

7 

19 

10312 

C 

0 

1 

4 

-1.00 

0.00 

0.31 

-0.26 

7 

19 

10312 

D 

0 

1 

4 

-3.21 

0.00 

0.03 

-0.54 

7 

20 

10295 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

7 

20 

10295 

A 

1 

21 

91 

1.50 

0.23 

1.04 

0.29 

7 

20 

10295 

B 

0 

2 

9 

0.44 

0.10 

0.58 

-0.29 

7 

20 

10295 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

20 

10295 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

21 

10273 

* 

-1 

1703 

90 

1.48 

0.03 

0.00 

-0.10 

7 

21 

10273 

A 

1 

172 

90 

2.10 

0.08 

0.95 

0.37 

7 

21 

10273 

B 

0 

9 

5 

0.63 

0.26 

0.57 

-0.26 

7 

21 

10273 

C 

0 

10 

5 

0.71 

0.20 

0.54 

-0.25 

7 

21 

10273 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

22 

10164 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

7 

22 

10164 

A 

1 

17 

74 

1.56 

0.34 

0.66 

0.56 

7 

22 

10164 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

7 

22 

10164 

C 

0 

2 

9 

-1.32 

0.06 

0.16 

-0.44 

7 

22 

10164 

D 

0 

4 

17 

-0.15 

0.86 

1.27 

-0.32 

7 

23 

10039 

* 

-1 

1254 

66 

1.65 

0.04 

0.00 

0.13 

7 

23 

10039 

A 

1 

430 

67 

1.91 

0.07 

0.97 

0.56 

7 

23 

10039 

B 

0 

72 

11 

0.12 

0.12 

0.76 

-0.26 

7 

23 

10039 

C 

0 

45 

7 

0.14 

0.14 

0.78 

-0.20 

7 

23 

10039 

D 

0 

93 

15 

-0.15 

0.13 

0.62 

-0.37 

7 

24 

1NBT34 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

7 

24 

1NBT34 

A 

1 

43 

59 

1.68 

0.16 

1.04 

0.38 

7 

24 

1NBT34 

B 

0 

17 

23 

1.18 

0.26 

1.62 

-0.06 

7 

24 

1NBT34 

C 

0 

13 

18 

0.20 

0.30 

0.58 

-0.43 

7 

24 

1NBT34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS First Grade Math Measure Development 


120 

Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

7 

25 

10020 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

7 

25 

10020 

A 

1 

13 

54 

2.36 

0.39 

0.84 

0.59 

7 

25 

10020 

B 

0 

4 

17 

0.55 

0.45 

0.58 

-0.33 

7 

25 

10020 

C 

0 

2 

8 

0.58 

0.39 

0.49 

-0.21 

7 

25 

10020 

D 

0 

5 

21 

0.82 

0.51 

1.12 

-0.28 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

1 

1MD19 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

8 

1 

1MD19 

A 

1 

64 

88 

1.75 

0.13 

0.91 

0.38 

8 

1 

1MD19 

B 

0 

7 

10 

0.35 

0.45 

0.71 

-0.36 

8 

1 

1MD19 

C 

0 

2 

3 

0.89 

0.85 

1.04 

-0.11 

8 

1 

1MD19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

2 

1MD26 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

8 

2 

1MD26 

A 

1 

55 

75 

1.64 

0.14 

0.86 

0.49 

8 

2 

1MD26 

B 

0 

12 

16 

0.27 

0.34 

0.76 

-0.38 

8 

2 

1MD26 

C 

0 

6 

8 

0.28 

0.34 

0.61 

-0.26 

8 

2 

1MD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

3 

1MD123 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

8 

3 

1MD123 

A 

1 

24 

33 

2.13 

0.26 

2.36 

0.33 

8 

3 

1MD123 

B 

0 

36 

49 

1.44 

0.17 

1.24 

-0.14 

8 

3 

1MD123 

C 

0 

13 

18 

1.05 

0.23 

0.66 

-0.23 

8 

3 

1MD123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

4 

31186 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.04 

8 

4 

31186 

A 

1 

16 

89 

1.31 

0.43 

1.21 

0.38 

8 

4 

31186 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

4 

31186 

C 

0 

1 

6 

2.54 

0.00 

10.26 

0.17 

8 

4 

31186 

D 

0 

1 

6 

-5.24 

0.00 

0.00 

-0.69 

8 

5 

30889 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.04 

8 

5 

30889 

A 

1 

15 

88 

0.97 

0.32 

1.24 

0.14 

8 

5 

30889 

B 

0 

2 

12 

0.47 

0.05 

1.00 

-0.14 

8 

5 

30889 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

5 

30889 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

6 

30269 

* 

-1 

1867 

99 

1.52 

0.03 

0.00 

0.00 

8 

6 

30269 

A 

1 

23 

85 

1.78 

0.35 

1.39 

0.35 

8 

6 

30269 

B 

0 

1 

4 

1.24 

0.00 

1.80 

-0.03 

8 

6 

30269 

C 

0 

1 

4 

1.23 

0.00 

1.77 

-0.04 

8 

6 

30269 

D 

0 

2 

7 

-0.98 

0.79 

0.26 

-0.42 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

7 

1G134 

* 

-1 

1815 

96 

1.51 

0.03 

0.00 

-0.05 

8 

7 

1G134 

A 

1 

69 

87 

2.04 

0.14 

1.02 

0.37 

8 

7 

1G134 

B 

0 

3 

4 

-0.25 

0.14 

0.19 

-0.35 

8 

7 

1G134 

C 

0 

7 

9 

1.15 

0.22 

0.88 

-0.19 

8 

7 

1G134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

8 

30745 

* 

-1 

1880 

99 

1.52 

0.03 

0.00 

-0.01 

8 

8 

30745 

A 

1 

11 

79 

1.99 

0.32 

0.91 

0.40 

8 

8 

30745 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

8 

30745 

C 

0 

1 

7 

2.63 

0.00 

3.51 

0.20 

8 

8 

30745 

D 

0 

2 

14 

-0.13 

0.91 

0.32 

-0.61 

8 

9 

1G319 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

8 

9 

1G319 

A 

1 

53 

70 

2.01 

0.15 

0.98 

0.36 

8 

9 

1G319 

B 

0 

5 

7 

0.74 

0.30 

0.54 

-0.25 

8 

9 

1G319 

C 

0 

18 

24 

1.26 

0.19 

1.02 

-0.25 

8 

9 

1G319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

10 

1G321 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

8 

10 

1G321 

A 

1 

38 

51 

2.56 

0.19 

0.84 

0.57 

8 

10 

1G321 

B 

0 

24 

32 

1.35 

0.11 

0.72 

-0.34 

8 

10 

1G321 

C 

0 

13 

17 

1.12 

0.26 

0.70 

-0.32 

8 

10 

1G321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

11 

10124 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.00 

8 

11 

10124 

A 

1 

18 

82 

1.79 

0.28 

0.96 

0.48 

8 

11 

10124 

B 

0 

2 

9 

0.65 

0.27 

0.66 

-0.22 

8 

11 

10124 

C 

0 

2 

9 

-0.11 

0.47 

0.33 

-0.42 

8 

11 

10124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

12 

10A213 

* 

-1 

1733 

91 

1.51 

0.03 

0.00 

-0.03 

8 

12 

10A213 

A 

1 

132 

82 

1.87 

0.10 

1.07 

0.34 

8 

12 

10A213 

B 

0 

20 

12 

0.96 

0.21 

1.15 

-0.23 

8 

12 

10A213 

C 

0 

9 

6 

0.48 

0.19 

0.51 

-0.25 

8 

12 

10A213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

13 

10092 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

8 

13 

10092 

A 

1 

16 

70 

1.52 

0.34 

1.08 

0.25 

8 

13 

10092 

B 

0 

2 

9 

0.08 

0.43 

0.45 

-0.30 

8 

13 

10092 

C 

0 

3 

13 

0.85 

0.90 

1.69 

-0.14 

8 

13 

10092 

D 

0 

2 

9 

1.52 

0.64 

2.12 

0.05 

8 

14 

1NBT538 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

8 

14 

1NBT538 

A 

1 

54 

63 

1.81 

0.17 

1.29 

0.38 

8 

14 

1NBT538 

B 

0 

15 

17 

0.75 

0.21 

0.79 

-0.28 

8 

14 

1NBT538 

C 

0 

17 

20 

1.01 

0.19 

1.03 

-0.19 

8 

14 

1NBT538 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

15 

1NBT530 

* 

-1 

1806 

95 

1.51 

0.03 

0.00 

-0.06 

8 

15 

1NBT530 

A 

1 

61 

69 

2.17 

0.14 

1.00 

0.37 

8 

15 

1NBT530 

B 

0 

8 

9 

1.35 

0.32 

1.02 

-0.16 

8 

15 

1NBT530 

C 

0 

19 

22 

1.29 

0.21 

1.00 

-0.30 

8 

15 

1NBT530 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

16 

10168 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

8 

16 

10168 

A 

1 

12 

50 

2.18 

0.59 

1.31 

0.46 

8 

16 

10168 

B 

0 

7 

29 

0.66 

0.22 

0.90 

-0.29 

8 

16 

10168 

C 

0 

3 

13 

1.14 

0.47 

1.51 

-0.06 

8 

16 

10168 

D 

0 

2 

8 

-0.11 

0.93 

0.52 

-0.27 

8 

17 

10070 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

8 

17 

10070 

A 

1 

12 

50 

2.96 

0.58 

1.79 

0.59 

8 

17 

10070 

B 

0 

1 

4 

-0.35 

0.00 

0.15 

-0.16 

8 

17 

10070 

C 

0 

9 

38 

0.97 

0.35 

0.91 

-0.17 

8 

17 

10070 

D 

0 

2 

8 

-3.86 

1.37 

0.02 

-0.66 

8 

18 

1MD326 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.06 

8 

18 

1MD326 

A 

1 

68 

92 

2.02 

0.13 

0.90 

0.34 

8 

18 

1MD326 

B 

0 

4 

5 

1.10 

0.38 

0.89 

-0.17 

8 

18 

1MD326 

C 

0 

2 

3 

-0.39 

0.08 

0.16 

-0.34 

8 

18 

1MD326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

19 

10001 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

8 

19 

10001 

A 

1 

21 

91 

1.19 

0.23 

1.04 

0.35 

8 

19 

10001 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

19 

10001 

C 

0 

1 

4 

0.03 

0.00 

0.55 

-0.21 

8 

19 

10001 

D 

0 

1 

4 

-0.27 

0.00 

0.41 

-0.27 

8 

20 

10373 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

8 

20 

10373 

A 

1 

20 

83 

1.45 

0.28 

0.55 

0.69 

8 

20 

10373 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

20 

10373 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

20 

10373 

D 

0 

4 

17 

-1.57 

0.57 

0.25 

-0.69 

8 

21 

10380 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

8 

21 

10380 

A 

1 

19 

83 

1.62 

0.37 

1.45 

0.20 

8 

21 

10380 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

21 

10380 

C 

0 

1 

4 

-0.40 

0.00 

0.29 

-0.27 

8 

21 

10380 

D 

0 

3 

13 

1.22 

0.03 

1.49 

-0.07 

8 

22 

30760 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.03 

8 

22 

30760 

A 

1 

15 

75 

1.50 

0.38 

1.28 

0.50 

8 

22 

30760 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

8 

22 

30760 

C 

0 

3 

15 

0.19 

0.26 

0.70 

-0.25 

8 

22 

30760 

D 

0 

2 

10 

-0.78 

0.13 

0.25 

-0.42 

8 

23 

10329 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

8 

23 

10329 

A 

1 

16 

67 

1.63 

0.19 

0.61 

0.67 

8 

23 

10329 

B 

0 

2 

8 

-0.37 

0.31 

0.31 

-0.30 

8 

23 

10329 

C 

0 

4 

17 

0.60 

0.53 

1.26 

-0.13 

8 

23 

10329 

D 

0 

2 

8 

-2.07 

1.13 

0.09 

-0.68 

8 

24 

1NBT327 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

8 

24 

1NBT327 

A 

1 

47 

64 

1.92 

0.15 

1.01 

0.39 

8 

24 

1NBT327 

B 

0 

10 

14 

0.48 

0.27 

0.47 

-0.40 

8 

24 

1NBT327 

C 

0 

16 

22 

1.35 

0.29 

1.62 

-0.12 

8 

24 

1NBT327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

8 

25 

10393 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

8 

25 

10393 

A 

1 

11 

48 

2.34 

0.57 

0.98 

0.52 

8 

25 

10393 

B 

0 

5 

22 

-0.04 

0.45 

0.53 

-0.29 

8 

25 

10393 

C 

0 

5 

22 

1.13 

0.52 

2.25 

-0.01 

8 

25 

10393 

D 

0 

2 

9 

-2.28 

2.94 

0.75 

-0.49 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

1 

1MD220 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

9 

1 

1MD220 

A 

1 

65 

90 

2.09 

0.13 

0.95 

0.40 

9 

1 

1MD220 

B 

0 

2 

3 

0.33 

0.00 

0.31 

-0.25 

9 

1 

1MD220 

C 

0 

5 

7 

0.71 

0.34 

0.57 

-0.31 

9 

1 

1MD220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

2 

1MD25 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

9 

2 

1MD25 

A 

1 

55 

77 

1.82 

0.15 

0.77 

0.55 

9 

2 

1MD25 

B 

0 

7 

10 

0.62 

0.41 

1.09 

-0.22 

9 

2 

1MD25 

C 

0 

9 

13 

-0.20 

0.22 

0.34 

-0.50 

9 

2 

1MD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

3 

1MD218 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

9 

3 

1MD218 

A 

1 

39 

56 

2.51 

0.18 

1.17 

0.33 

9 

3 

1MD218 

B 

0 

19 

27 

1.61 

0.23 

1.00 

-0.30 

9 

3 

1MD218 

C 

0 

12 

17 

1.97 

0.29 

1.39 

-0.08 

9 

3 

1MD218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

4 

30261 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

9 

4 

30261 

A 

1 

20 

91 

1.11 

0.29 

0.74 

0.57 

9 

4 

30261 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

4 

30261 

C 

0 

1 

5 

-1.07 

0.00 

0.35 

-0.28 

9 

4 

30261 

D 

0 

1 

5 

-2.69 

0.00 

0.07 

-0.51 

9 

5 

10409 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

9 

5 

10409 

A 

1 

22 

92 

1.74 

0.34 

0.80 

0.44 

9 

5 

10409 

B 

0 

1 

4 

-0.96 

0.00 

0.22 

-0.31 

9 

5 

10409 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

5 

10409 

D 

0 

1 

4 

-0.85 

0.00 

0.24 

-0.30 

9 

6 

30589 

* 

-1 

1867 

99 

1.53 

0.03 

0.00 

0.04 

9 

6 

30589 

A 

1 

21 

78 

1.39 

0.42 

0.98 

0.33 

9 

6 

30589 

B 

0 

1 

4 

0.55 

0.00 

1.40 

-0.05 

9 

6 

30589 

C 

0 

2 

7 

0.35 

0.20 

1.18 

-0.10 

9 

6 

30589 

D 

0 

3 

11 

-0.68 

1.36 

2.09 

-0.32 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

7 

10425 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

9 

7 

10425 

A 

1 

18 

75 

1.66 

0.40 

0.80 

0.48 

9 

7 

10425 

B 

0 

1 

4 

1.03 

0.00 

1.68 

-0.02 

9 

7 

10425 

C 

0 

2 

8 

-0.41 

1.17 

0.70 

-0.28 

9 

7 

10425 

D 

0 

3 

13 

-0.62 

0.72 

0.54 

-0.39 

9 

8 

30148 

* 

-1 

1879 

99 

1.52 

0.03 

0.00 

0.00 

9 

8 

30148 

A 

1 

11 

73 

1.94 

0.48 

1.14 

0.37 

9 

8 

30148 

B 

0 

1 

7 

-1.26 

0.00 

0.10 

-0.47 

9 

8 

30148 

C 

0 

2 

13 

1.96 

0.47 

2.72 

0.09 

9 

8 

30148 

D 

0 

1 

7 

-0.26 

0.00 

0.27 

-0.31 

9 

9 

31163 

* 

-1 

1554 

82 

1.45 

0.04 

0.00 

-0.11 

9 

9 

31163 

A 

1 

238 

70 

2.11 

0.08 

1.17 

0.32 

9 

9 

31163 

B 

0 

15 

4 

1.19 

0.32 

1.33 

-0.12 

9 

9 

31163 

C 

0 

87 

26 

1.28 

0.11 

1.26 

-0.28 

9 

9 

31163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

10 

30459 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.01 

9 

10 

30459 

A 

1 

10 

40 

2.57 

0.39 

0.59 

0.65 

9 

10 

30459 

B 

0 

2 

8 

1.94 

0.43 

1.83 

0.11 

9 

10 

30459 

C 

0 

5 

20 

0.03 

0.53 

0.38 

-0.43 

9 

10 

30459 

D 

0 

8 

32 

0.53 

0.41 

0.69 

-0.37 

9 

11 

10057 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

9 

11 

10057 

A 

1 

17 

74 

1.47 

0.29 

0.69 

0.61 

9 

11 

10057 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

11 

10057 

C 

0 

4 

17 

-0.10 

0.26 

0.55 

-0.37 

9 

11 

10057 

D 

0 

2 

9 

-0.97 

0.80 

0.28 

-0.45 

9 

12 

10103 

* 

-1 

1701 

90 

1.54 

0.03 

0.00 

0.04 

9 

12 

10103 

A 

1 

151 

78 

1.59 

0.09 

1.00 

0.35 

9 

12 

10103 

B 

0 

20 

10 

0.39 

0.17 

0.71 

-0.29 

9 

12 

10103 

C 

0 

22 

11 

0.82 

0.23 

1.40 

-0.17 

9 

12 

10103 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

13 

10105 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

9 

13 

10105 

A 

1 

16 

67 

2.00 

0.37 

0.85 

0.60 

9 

13 

10105 

B 

0 

2 

8 

-0.33 

0.93 

0.43 

-0.22 

9 

13 

10105 

C 

0 

3 

13 

0.27 

0.38 

0.61 

-0.17 

9 

13 

10105 

D 

0 

3 

13 

-1.54 

1.85 

0.58 

-0.51 

9 

14 

1NBT525 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

9 

14 

1NBT525 

A 

1 

49 

70 

2.03 

0.12 

0.89 

0.43 

9 

14 

1NBT525 

B 

0 

3 

4 

0.70 

0.25 

0.42 

-0.26 

9 

14 

1NBT525 

C 

0 

18 

26 

1.28 

0.18 

1.07 

-0.33 

9 

14 

1NBT525 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

15 

10135 

* 

-1 

1705 

90 

1.52 

0.03 

0.00 

-0.02 

9 

15 

10135 

A 

1 

119 

63 

2.09 

0.11 

0.88 

0.49 

9 

15 

10135 

B 

0 

34 

18 

0.97 

0.17 

1.02 

-0.22 

9 

15 

10135 

C 

0 

28 

15 

0.81 

0.19 

0.93 

-0.25 

9 

15 

10135 

D 

0 

8 

4 

-0.44 

0.28 

0.22 

-0.32 

9 

16 

10054 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

9 

16 

10054 

A 

1 

12 

50 

1.98 

0.48 

1.07 

0.43 

9 

16 

10054 

B 

0 

3 

13 

0.73 

0.41 

0.84 

-0.15 

9 

16 

10054 

C 

0 

2 

8 

0.15 

0.50 

0.46 

-0.24 

9 

16 

10054 

D 

0 

7 

29 

0.84 

0.54 

1.95 

-0.21 

9 

17 

10093 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.04 

9 

17 

10093 

A 

1 

11 

44 

2.15 

0.58 

1.47 

0.48 

9 

17 

10093 

B 

0 

3 

12 

1.11 

0.99 

2.21 

0.01 

9 

17 

10093 

C 

0 

11 

44 

-0.10 

0.58 

0.67 

-0.48 

9 

17 

10093 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

18 

1MD318 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

9 

18 

1MD318 

A 

1 

71 

89 

1.82 

0.13 

0.99 

0.40 

9 

18 

1MD318 

B 

0 

7 

9 

0.47 

0.31 

0.69 

-0.31 

9 

18 

1MD318 

C 

0 

2 

3 

-0.26 

0.16 

0.24 

-0.26 

9 

18 

1MD318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

19 

10334 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

9 

19 

10334 

A 

1 

22 

92 

1.48 

0.37 

1.12 

0.15 

9 

19 

10334 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

19 

10334 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

19 

10334 

D 

0 

2 

8 

0.60 

0.31 

1.15 

-0.15 

9 

20 

10220 

* 

-1 

1873 

99 

1.54 

0.03 

0.00 

0.07 

9 

20 

10220 

A 

1 

17 

81 

1.13 

0.29 

1.02 

0.63 

9 

20 

10220 

B 

0 

3 

14 

-2.11 

1.56 

0.40 

-0.62 

9 

20 

10220 

C 

0 

1 

5 

-0.56 

0.00 

0.38 

-0.14 

9 

20 

10220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

21 

10015 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

9 

21 

10015 

A 

1 

19 

79 

1.58 

0.36 

0.88 

0.41 

9 

21 

10015 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

21 

10015 

C 

0 

1 

4 

-0.61 

0.00 

0.31 

-0.24 

9 

21 

10015 

D 

0 

4 

17 

0.06 

0.79 

1.21 

-0.32 

9 

22 

10372 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.04 

9 

22 

10372 

A 

1 

14 

70 

1.52 

0.56 

1.84 

0.43 

9 

22 

10372 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

9 

22 

10372 

C 

0 

3 

15 

-0.40 

0.48 

0.63 

-0.27 

9 

22 

10372 

D 

0 

3 

15 

-0.46 

1.43 

1.53 

-0.28 

9 

23 

10318 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

9 

23 

10318 

A 

1 

17 

74 

2.26 

0.35 

0.82 

0.59 

9 

23 

10318 

B 

0 

3 

13 

0.79 

0.46 

0.89 

-0.23 

9 

23 

10318 

C 

0 

2 

9 

-0.76 

0.01 

0.15 

-0.48 

9 

23 

10318 

D 

0 

1 

4 

0.06 

0.00 

0.34 

-0.22 

9 

24 

30757 

* 

-1 

1878 

99 

1.53 

0.03 

0.00 

0.04 

9 

24 

30757 

A 

1 

8 

50 

1.30 

0.58 

1.20 

0.25 

9 

24 

30757 

B 

0 

5 

31 

0.59 

0.62 

1.56 

-0.16 

9 

24 

30757 

C 

0 

2 

13 

0.51 

1.42 

1.77 

-0.11 

9 

24 

30757 

D 

0 

1 

6 

0.61 

0.00 

0.89 

-0.06 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

9 

25 

1NBT38 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.06 

9 

25 

1NBT38 

A 

1 

46 

62 

2.23 

0.18 

1.08 

0.37 

9 

25 

1NBT38 

B 

0 

19 

26 

1.17 

0.18 

0.76 

-0.38 

9 

25 

1NBT38 

C 

0 

9 

12 

1.81 

0.21 

1.32 

-0.03 

9 

25 

1NBT38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

1 

1MD126 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

10 

1 

1MD126 

A 

1 

70 

86 

1.55 

0.13 

1.05 

0.21 

10 

1 

1MD126 

B 

0 

6 

7 

0.64 

0.39 

0.89 

-0.21 

10 

1 

1MD126 

C 

0 

5 

6 

1.21 

0.36 

1.50 

-0.06 

10 

1 

1MD126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

2 

1MD27 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

10 

2 

1MD27 

A 

1 

61 

85 

2.14 

0.13 

0.94 

0.43 

10 

2 

1MD27 

B 

0 

6 

8 

0.39 

0.21 

0.34 

-0.43 

10 

2 

1MD27 

C 

0 

5 

7 

1.36 

0.35 

1.00 

-0.15 

10 

2 

1MD27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

3 

1MD132 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

10 

3 

1MD132 

A 

1 

36 

38 

2.49 

0.18 

0.93 

0.46 

10 

3 

1MD132 

B 

0 

53 

56 

1.53 

0.13 

0.99 

-0.34 

10 

3 

1MD132 

C 

0 

6 

6 

0.96 

0.14 

0.39 

-0.22 

10 

3 

1MD132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

4 

1G13 

* 

-1 

1818 

96 

1.53 

0.03 

0.00 

0.02 

10 

4 

1G13 

A 

1 

73 

96 

1.48 

0.14 

0.90 

0.33 

10 

4 

1G13 

B 

0 

2 

3 

-0.43 

1.04 

0.49 

-0.24 

10 

4 

1G13 

C 

0 

1 

1 

-1.06 

0.00 

0.17 

-0.22 

10 

4 

1G13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

5 

30595 

* 

-1 

1868 

99 

1.53 

0.03 

0.00 

0.02 

10 

5 

30595 

A 

1 

23 

88 

1.49 

0.35 

1.12 

0.33 

10 

5 

30595 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

5 

30595 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

5 

30595 

D 

0 

3 

12 

-0.20 

0.54 

0.79 

-0.33 

10 

6 

30591 

* 

-1 

1875 

99 

1.52 

0.03 

0.00 

-0.01 

10 

6 

30591 

A 

1 

17 

89 

1.85 

0.32 

1.01 

0.35 

10 

6 

30591 

B 

0 

2 

11 

0.36 

0.01 

0.46 

-0.35 

10 

6 

30591 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

6 

30591 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

7 

30520 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.06 

10 

7 

30520 

A 

1 

15 

71 

0.81 

0.36 

1.43 

0.13 

10 

7 

30520 

B 

0 

1 

5 

-0.33 

0.00 

0.47 

-0.19 

10 

7 

30520 

C 

0 

1 

5 

0.21 

0.00 

0.81 

-0.09 

10 

7 

30520 

D 

0 

4 

19 

0.72 

0.43 

1.81 

0.00 

10 

8 

1G317 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

10 

8 

1G317 

A 

1 

59 

82 

2.13 

0.14 

1.03 

0.37 

10 

8 

1G317 

B 

0 

2 

3 

1.36 

1.49 

1.83 

-0.09 

10 

8 

1G317 

C 

0 

11 

15 

1.04 

0.21 

0.72 

-0.35 

10 

8 

1G317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

9 

1G221 

* 

-1 

1749 

92 

1.54 

0.03 

0.00 

0.03 

10 

9 

1G221 

A 

1 

91 

63 

1.72 

0.12 

1.05 

0.37 

10 

9 

1G221 

B 

0 

21 

14 

0.52 

0.26 

0.91 

-0.28 

10 

9 

1G221 

C 

0 

33 

23 

0.95 

0.18 

1.25 

-0.19 

10 

9 

1G221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

10 

10420 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10 

10 

10420 

A 

1 

9 

38 

2.68 

0.67 

1.33 

0.59 

10 

10 

10420 

B 

0 

4 

17 

0.08 

0.15 

0.35 

-0.28 

10 

10 

10420 

C 

0 

8 

33 

0.96 

0.49 

1.77 

-0.11 

10 

10 

10420 

D 

0 

3 

13 

-0.73 

0.55 

0.19 

-0.40 

10 

11 

10A219 

* 

-1 

1746 

92 

1.51 

0.03 

0.00 

-0.05 

10 

11 

10A219 

A 

1 

125 

84 

1.99 

0.10 

0.91 

0.47 

10 

11 

10A219 

B 

0 

16 

11 

0.21 

0.19 

0.45 

-0.44 

10 

11 

10A219 

C 

0 

7 

5 

0.84 

0.37 

0.89 

-0.17 

10 

11 

10A219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

12 

10A425 

* 

-1 

1726 

91 

1.53 

0.03 

0.00 

0.01 

10 

12 

10A425 

A 

1 

134 

80 

1.73 

0.09 

0.89 

0.43 

10 

12 

10A425 

B 

0 

24 

14 

0.48 

0.20 

0.79 

-0.35 

10 

12 

10A425 

C 

0 

10 

6 

0.56 

0.18 

0.65 

-0.20 

10 

12 

10A425 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

13 

1NBT514 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

10 

13 

1NBT514 

A 

1 

60 

75 

1.96 

0.14 

0.95 

0.45 

10 

13 

1NBT514 

B 

0 

12 

15 

0.64 

0.25 

0.71 

-0.36 

10 

13 

1NBT514 

C 

0 

8 

10 

0.83 

0.39 

0.89 

-0.23 

10 

13 

1NBT514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

14 

1NBT536 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

10 

14 

1NBT536 

A 

1 

48 

66 

2.05 

0.14 

0.83 

0.56 

10 

14 

1NBT536 

B 

0 

12 

16 

0.67 

0.23 

0.62 

-0.37 

10 

14 

1NBT536 

C 

0 

13 

18 

0.77 

0.29 

0.80 

-0.34 

10 

14 

1NBT536 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

15 

1NBT511 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

10 

15 

1NBT511 

A 

1 

48 

69 

2.43 

0.19 

1.10 

0.51 

10 

15 

1NBT511 

B 

0 

11 

16 

0.81 

0.18 

0.54 

-0.36 

10 

15 

1NBT511 

C 

0 

11 

16 

1.03 

0.27 

0.80 

-0.29 

10 

15 

1NBT511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

16 

10166 

* 

-1 

1705 

90 

1.49 

0.03 

0.00 

-0.08 

10 

16 

10166 

A 

1 

116 

61 

2.31 

0.10 

0.97 

0.45 

10 

16 

10166 

B 

0 

40 

21 

1.36 

0.14 

1.04 

-0.22 

10 

16 

10166 

C 

0 

29 

15 

1.06 

0.23 

1.00 

-0.29 

10 

16 

10166 

D 

0 

4 

2 

0.49 

0.55 

0.44 

-0.17 

10 

17 

1NBT516 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

10 

17 

1NBT516 

A 

1 

45 

64 

2.65 

0.16 

0.84 

0.57 

10 

17 

1NBT516 

B 

0 

10 

14 

1.32 

0.22 

0.61 

-0.31 

10 

17 

1NBT516 

C 

0 

15 

21 

1.30 

0.20 

0.66 

-0.40 

10 

17 

1NBT516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

18 

1MD328 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

10 

18 

1MD328 

A 

1 

71 

88 

1.59 

0.12 

0.97 

0.31 

10 

18 

1MD328 

B 

0 

6 

7 

0.80 

0.41 

1.20 

-0.17 

10 

18 

1MD328 

C 

0 

4 

5 

0.24 

0.40 

0.55 

-0.26 

10 

18 

1MD328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

19 

10272 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10 

19 

10272 

A 

1 

21 

88 

1.42 

0.31 

0.66 

0.60 

10 

19 

10272 

B 

0 

1 

4 

-0.73 

0.00 

0.42 

-0.21 

10 

19 

10272 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

19 

10272 

D 

0 

2 

8 

-2.28 

1.49 

0.20 

-0.57 

10 

20 

10262 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

10 

20 

10262 

A 

1 

19 

86 

1.40 

0.29 

0.70 

0.58 

10 

20 

10262 

B 

0 

1 

5 

-0.31 

0.00 

0.46 

-0.21 

10 

20 

10262 

C 

0 

2 

9 

-1.30 

0.74 

0.22 

-0.53 

10 

20 

10262 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

21 

10021 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10 

21 

10021 

A 

1 

18 

78 

1.39 

0.37 

1.00 

0.40 

10 

21 

10021 

B 

0 

1 

4 

0.32 

0.00 

0.84 

-0.11 

10 

21 

10021 

C 

0 

2 

9 

-0.13 

0.52 

0.60 

-0.25 

10 

21 

10021 

D 

0 

2 

9 

-0.14 

0.13 

0.53 

-0.25 

10 

22 

10399 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10 

22 

10399 

A 

1 

19 

79 

2.06 

0.37 

0.67 

0.59 

10 

22 

10399 

B 

0 

1 

4 

0.00 

0.00 

0.47 

-0.16 

10 

22 

10399 

C 

0 

3 

13 

0.00 

0.32 

0.52 

-0.29 

10 

22 

10399 

D 

0 

1 

4 

-3.76 

0.00 

0.01 

-0.57 

10 

23 

10107 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10 

23 

10107 

A 

1 

17 

71 

2.36 

0.35 

0.67 

0.68 

10 

23 

10107 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10 

23 

10107 

C 

0 

5 

21 

-0.20 

0.30 

0.35 

-0.56 

10 

23 

10107 

D 

0 

2 

8 

-0.04 

0.22 

0.35 

-0.30 

10 

24 

10291 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10 

24 

10291 

A 

1 

12 

50 

2.09 

0.44 

0.76 

0.66 

10 

24 

10291 

B 

0 

4 

17 

-0.25 

0.76 

0.81 

-0.29 

10 

24 

10291 

C 

0 

3 

13 

-0.07 

0.96 

1.08 

-0.20 

10 

24 

10291 

D 

0 

5 

21 

-0.46 

0.54 

0.48 

-0.39 



easyCBM CCSS First Grade Math Measure Development 


135 

Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10 

25 

10121 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10 

25 

10121 

A 

1 

11 

48 

2.14 

0.49 

1.61 

0.61 

10 

25 

10121 

B 

0 

2 

9 

0.00 

0.03 

0.34 

-0.22 

10 

25 

10121 

C 

0 

7 

30 

0.50 

0.35 

0.79 

-0.26 

10 

25 

10121 

D 

0 

3 

13 

-0.41 

0.75 

0.37 

-0.37 



easyCBM CCSS First Grade Math Measure Development 


136 

Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

1 

1MD226 

* 

-1 

1739 

92 

1.51 

0.03 

0.00 

-0.03 

BMF 

1 

1MD226 

A 

1 

137 

88 

1.73 

0.09 

1.02 

0.23 

BMF 

1 

1MD226 

B 

0 

8 

5 

1.18 

0.24 

1.11 

-0.10 

BMF 

1 

1MD226 

C 

0 

10 

6 

0.86 

0.29 

0.90 

-0.20 

BMF 

1 

1MD226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

2 

1MD117 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

BMF 

2 

1MD117 

A 

1 

80 

84 

2.05 

0.11 

0.86 

0.41 

BMF 

2 

1MD117 

B 

0 

4 

4 

0.34 

0.19 

0.32 

-0.29 

BMF 

2 

1MD117 

C 

0 

11 

12 

1.02 

0.40 

2.85 

-0.28 

BMF 

2 

1MD117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

3 

1MD231 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

BMF 

3 

1MD231 

A 

1 

39 

49 

2.24 

0.18 

0.96 

0.48 

BMF 

3 

1MD231 

B 

0 

13 

16 

1.47 

0.36 

1.49 

-0.07 

BMF 

3 

1MD231 

C 

0 

28 

35 

0.91 

0.14 

0.63 

-0.46 

BMF 

3 

1MD231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

4 

1G31 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

BMF 

4 

1G31 

A 

1 

69 

97 

1.99 

0.16 

0.95 

0.26 

BMF 

4 

1G31 

B 

0 

1 

1 

-0.47 

0.00 

0.20 

-0.21 

BMF 

4 

1G31 

C 

0 

1 

1 

0.20 

0.00 

0.38 

-0.15 

BMF 

4 

1G31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

5 

30110 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.03 

BMF 

5 

30110 

A 

1 

18 

90 

1.31 

0.36 

0.93 

0.33 

BMF 

5 

30110 

B 

0 

1 

5 

-0.20 

0.00 

0.50 

-0.21 

BMF 

5 

30110 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

5 

30110 

D 

0 

1 

5 

-0.44 

0.00 

0.40 

-0.24 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

6 

1G229 

* 

-1 

1746 

92 

1.51 

0.03 

0.00 

-0.05 

BMF 

6 

1G229 

A 

1 

133 

90 

1.92 

0.10 

0.89 

0.42 

BMF 

6 

1G229 

B 

0 

11 

7 

0.00 

0.29 

0.45 

-0.41 

BMF 

6 

1G229 

C 

0 

4 

3 

0.84 

0.19 

0.73 

-0.12 

BMF 

6 

1G229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

7 

1G122 

* 

-1 

1809 

96 

1.53 

0.03 

0.00 

0.01 

BMF 

7 

1G122 

A 

1 

72 

85 

1.53 

0.13 

1.07 

0.15 

BMF 

7 

1G122 

B 

0 

8 

9 

0.81 

0.42 

1.48 

-0.19 

BMF 

7 

1G122 

C 

0 

5 

6 

1.49 

0.57 

3.50 

0.01 

BMF 

7 

1G122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

8 

1G123 

* 

-1 

1813 

96 

1.52 

0.03 

0.00 

-0.03 

BMF 

8 

1G123 

A 

1 

65 

80 

1.81 

0.12 

1.10 

0.20 

BMF 

8 

1G123 

B 

0 

3 

4 

0.85 

0.16 

0.49 

-0.17 

BMF 

8 

1G123 

C 

0 

13 

16 

1.43 

0.32 

1.54 

-0.13 

BMF 

8 

1G123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

9 

1G133 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

BMF 

9 

1G133 

A 

1 

46 

63 

1.89 

0.16 

1.16 

0.35 

BMF 

9 

1G133 

B 

0 

19 

26 

0.91 

0.24 

0.86 

-0.36 

BMF 

9 

1G133 

C 

0 

8 

11 

1.51 

0.32 

1.62 

-0.03 

BMF 

9 

1G133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

10 

31208 

* 

-1 

1878 

99 

1.53 

0.03 

0.00 

0.04 

BMF 

10 

31208 

A 

1 

6 

38 

2.30 

0.94 

1.57 

0.50 

BMF 

10 

31208 

B 

0 

5 

31 

1.06 

0.44 

1.68 

0.04 

BMF 

10 

31208 

C 

0 

1 

6 

-1.55 

0.00 

0.10 

-0.30 

BMF 

10 

31208 

D 

0 

4 

25 

-0.67 

1.06 

0.56 

-0.43 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item IF) 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

11 

10076 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.01 

BMF 

11 

10076 

A 

1 

20 

80 

1.89 

0.32 

0.79 

0.53 

BMF 

11 

10076 

B 

0 

3 

12 

0.46 

0.90 

1.56 

-0.23 

BMF 

11 

10076 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

11 

10076 

D 

0 

2 

8 

-1.31 

0.39 

0.13 

-0.51 

BMF 

12 

1NBT58 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

BMF 

12 

1NBT58 

A 

1 

65 

81 

1.95 

0.13 

0.82 

0.52 

BMF 

12 

1NBT58 

B 

0 

8 

10 

0.37 

0.23 

0.48 

-0.36 

BMF 

12 

1NBT58 

C 

0 

7 

9 

0.34 

0.41 

0.62 

-0.34 

BMF 

12 

1NBT58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

13 

10A21 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

BMF 

13 

10A21 

A 

1 

57 

74 

2.02 

0.14 

0.88 

0.49 

BMF 

13 

10A21 

B 

0 

16 

21 

0.72 

0.31 

1.03 

-0.39 

BMF 

13 

10A21 

C 

0 

4 

5 

0.28 

0.30 

0.38 

-0.26 

BMF 

13 

10A21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

14 

1NBT611 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

BMF 

14 

1NBT611 

A 

1 

45 

62 

1.77 

0.15 

0.85 

0.49 

BMF 

14 

1NBT611 

B 

0 

7 

10 

0.72 

0.23 

0.76 

-0.16 

BMF 

14 

1NBT611 

C 

0 

21 

29 

0.50 

0.27 

0.95 

-0.43 

BMF 

14 

1NBT611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

15 

1NBT532 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

BMF 

15 

1NBT532 

A 

1 

41 

59 

1.98 

0.20 

1.28 

0.49 

BMF 

15 

1NBT532 

B 

0 

26 

37 

0.77 

0.14 

0.78 

-0.42 

BMF 

15 

1NBT532 

C 

0 

3 

4 

0.24 

0.74 

0.57 

-0.20 

BMF 

15 

1NBT532 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

16 

1NBT528 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

BMF 

16 

1NBT528 

A 

1 

43 

61 

2.18 

0.17 

1.05 

0.40 

BMF 

16 

1NBT528 

B 

0 

16 

23 

1.16 

0.24 

0.94 

-0.30 

BMF 

16 

1NBT528 

C 

0 

11 

16 

1.30 

0.36 

1.44 

-0.19 

BMF 

16 

1NBT528 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

17 

10188 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

BMF 

17 

10188 

A 

1 

11 

48 

2.67 

0.54 

1.12 

0.63 

BMF 

17 

10188 

B 

0 

5 

22 

0.65 

0.48 

0.88 

-0.24 

BMF 

17 

10188 

C 

0 

6 

26 

0.05 

0.49 

0.59 

-0.47 

BMF 

17 

10188 

D 

0 

1 

4 

1.08 

0.00 

0.87 

-0.05 

BMF 

18 

1MD33 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

BMF 

18 

1MD33 

A 

1 

57 

81 

2.13 

0.18 

1.11 

0.26 

BMF 

18 

1MD33 

B 

0 

4 

6 

1.33 

0.21 

0.99 

-0.11 

BMF 

18 

1MD33 

C 

0 

9 

13 

1.13 

0.50 

2.24 

-0.23 

BMF 

18 

1MD33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

19 

10007 

* 

-1 

1253 

66 

1.65 

0.04 

0.00 

0.13 

BMF 

19 

10007 

A 

1 

570 

89 

1.48 

0.06 

0.96 

0.35 

BMF 

19 

10007 

B 

0 

31 

5 

0.07 

0.31 

2.39 

-0.17 

BMF 

19 

10007 

C 

0 

27 

4 

-0.10 

0.12 

0.68 

-0.18 

BMF 

19 

10007 

D 

0 

13 

2 

-1.82 

0.43 

0.22 

-0.28 

BMF 

20 

10083 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

BMF 

20 

10083 

A 

1 

21 

88 

1.41 

0.36 

1.10 

0.21 

BMF 

20 

10083 

B 

0 

1 

4 

1.65 

0.00 

2.95 

0.05 

BMF 

20 

10083 

C 

0 

2 

8 

-0.21 

0.25 

0.47 

-0.29 

BMF 

20 

10083 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

21 

10264 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

BMF 

21 

10264 

A 

1 

20 

83 

2.07 

0.33 

0.69 

0.62 

BMF 

21 

10264 

B 

0 

1 

4 

-0.11 

0.00 

0.40 

-0.21 

BMF 

21 

10264 

C 

0 

3 

13 

-0.93 

0.01 

0.18 

-0.57 

BMF 

21 

10264 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

22 

10045 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

0.00 

BMF 

22 

10045 

A 

1 

17 

81 

2.08 

0.40 

1.01 

0.52 

BMF 

22 

10045 

B 

0 

1 

5 

0.68 

0.00 

0.63 

-0.09 

BMF 

22 

10045 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

22 

10045 

D 

0 

3 

14 

-1.25 

1.99 

0.67 

-0.53 

BMF 

23 

10025 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

BMF 

23 

10025 

A 

1 

16 

67 

1.37 

0.39 

1.76 

0.20 

BMF 

23 

10025 

B 

0 

4 

17 

1.40 

0.56 

2.47 

0.07 

BMF 

23 

10025 

C 

0 

4 

17 

0.12 

0.52 

0.73 

-0.33 

BMF 

23 

10025 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

24 

10198 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

BMF 

24 

10198 

A 

1 

13 

54 

2.11 

0.45 

0.75 

0.59 

BMF 

24 

10198 

B 

0 

2 

8 

-1.68 

0.81 

0.10 

-0.47 

BMF 

24 

10198 

C 

0 

5 

21 

0.64 

0.51 

1.36 

-0.14 

BMF 

24 

10198 

D 

0 

4 

17 

-0.09 

0.68 

0.59 

-0.30 

BMF 

25 

10036 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

BMF 

25 

10036 

A 

1 

11 

46 

2.34 

0.40 

0.70 

0.68 

BMF 

25 

10036 

B 

0 

2 

8 

-0.23 

1.88 

0.85 

-0.27 

BMF 

25 

10036 

C 

0 

5 

21 

0.24 

0.33 

0.52 

-0.31 

BMF 

25 

10036 

D 

0 

6 

25 

0.33 

0.41 

0.68 

-0.32 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

26 

2G335 

* 

-1 

3908 

98 

1.51 

0.02 

0.00 

-0.01 

BMF 

26 

2G335 

A 

1 

75 

89 

1.73 

0.13 

0.90 

0.38 

BMF 

26 

2G335 

B 

0 

8 

10 

0.25 

0.34 

0.66 

-0.37 

BMF 

26 

2G335 

C 

0 

1 

1 

0.86 

0.00 

0.76 

-0.07 

BMF 

26 

2G335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

27 

23158 

* 

-1 

3947 

99 

1.51 

0.02 

0.00 

-0.01 

BMF 

27 

23158 

A 

1 

37 

82 

2.06 

0.25 

0.77 

0.52 

BMF 

27 

23158 

B 

0 

6 

13 

0.13 

0.38 

0.70 

-0.36 

BMF 

27 

23158 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

27 

23158 

D 

0 

2 

4 

-1.05 

0.38 

0.16 

-0.35 

BMF 

28 

22183 

* 

-1 

1471 

37 

1.65 

0.03 

0.00 

0.07 

BMF 

28 

22183 

A 

1 

1723 

68 

1.97 

0.03 

0.99 

0.51 

BMF 

28 

22183 

B 

0 

174 

7 

0.17 

0.08 

0.81 

-0.23 

BMF 

28 

22183 

C 

0 

208 

8 

0.49 

0.08 

0.99 

-0.19 

BMF 

28 

22183 

D 

0 

416 

17 

0.26 

0.06 

0.83 

-0.34 

BMF 

29 

2NBT67 

* 

-1 

3907 

98 

1.51 

0.02 

0.00 

-0.01 

BMF 

29 

2NBT67 

A 

1 

56 

66 

1.99 

0.15 

0.95 

0.47 

BMF 

29 

2NBT67 

B 

0 

10 

12 

0.73 

0.23 

0.63 

-0.28 

BMF 

29 

2NBT67 

C 

0 

19 

22 

0.94 

0.19 

0.87 

-0.32 

BMF 

29 

2NBT67 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

30 

22344 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

BMF 

30 

22344 

A 

1 

19 

43 

2.28 

0.34 

0.72 

0.61 

BMF 

30 

22344 

B 

0 

5 

11 

0.84 

0.19 

0.77 

-0.13 

BMF 

30 

22344 

C 

0 

11 

25 

0.48 

0.28 

0.70 

-0.35 

BMF 

30 

22344 

D 

0 

9 

20 

0.59 

0.15 

0.62 

-0.27 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMF 

31 

KCC510 

* 

-1 

1269 

96 

1.40 

0.04 

0.00 

0.06 

BMF 

31 

KCC510 

A 

1 

45 

90 

1.00 

0.12 

1.05 

0.24 

BMF 

31 

KCC510 

B 

0 

1 

2 

0.47 

0.00 

0.81 

-0.08 

BMF 

31 

KCC510 

C 

0 

4 

8 

0.31 

0.29 

0.76 

-0.23 

BMF 

31 

KCC510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

32 

KOI 26 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.02 

BMF 

32 

KOI 26 

A 

1 

16 

84 

1.86 

0.40 

0.87 

0.36 

BMF 

32 

KOI 26 

B 

0 

2 

11 

0.35 

1.23 

1.11 

-0.27 

BMF 

32 

KOI 26 

C 

0 

1 

5 

0.17 

0.00 

0.50 

-0.21 

BMF 

32 

KOI 26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMF 

33 

K0376 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.02 

BMF 

33 

K0376 

A 

1 

13 

72 

2.43 

0.42 

0.69 

0.66 

BMF 

33 

K0376 

B 

0 

2 

11 

0.61 

0.54 

0.77 

-0.21 

BMF 

33 

K0376 

C 

0 

1 

6 

-2.49 

0.00 

0.03 

-0.55 

BMF 

33 

K0376 

D 

0 

2 

11 

-0.02 

0.18 

0.36 

-0.33 

BMF 

34 

K0020 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.01 

BMF 

34 

K0020 

A 

1 

10 

59 

2.34 

0.38 

0.65 

0.61 

BMF 

34 

K0020 

B 

0 

1 

6 

0.72 

0.00 

0.52 

-0.14 

BMF 

34 

K0020 

C 

0 

4 

24 

1.05 

0.43 

0.94 

-0.19 

BMF 

34 

K0020 

D 

0 

2 

12 

-0.81 

1.56 

0.28 

-0.57 

BMF 

35 

KNBT114 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.03 

BMF 

35 

KNBT114 

A 

1 

10 

21 

1.78 

0.53 

1.19 

0.29 

BMF 

35 

KNBT114 

B 

0 

7 

15 

1.31 

0.39 

1.48 

0.06 

BMF 

35 

KNBT114 

C 

0 

31 

65 

0.90 

0.16 

0.98 

-0.29 

BMF 

35 

KNBT114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMF = Benchmark Fall. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

1 

1MD111 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

BMW 

1 

1MD111 

A 

1 

65 

90 

1.88 

0.11 

0.94 

0.28 

BMW 

1 

1MD111 

B 

0 

3 

4 

0.86 

0.25 

0.56 

-0.21 

BMW 

1 

1MD111 

C 

0 

4 

6 

1.10 

0.60 

1.19 

-0.18 

BMW 

1 

1MD111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

2 

1MD21 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

BMW 

2 

1MD21 

A 

1 

64 

85 

2.05 

0.14 

1.04 

0.27 

BMW 

2 

1MD21 

B 

0 

9 

12 

1.32 

0.21 

0.96 

-0.20 

BMW 

2 

1MD21 

C 

0 

2 

3 

0.60 

0.90 

0.57 

-0.19 

BMW 

2 

1MD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

3 

1MD217 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

BMW 

3 

1MD217 

A 

1 

53 

56 

2.19 

0.15 

1.02 

0.34 

BMW 

3 

1MD217 

B 

0 

18 

19 

1.43 

0.19 

0.94 

-0.19 

BMW 

3 

1MD217 

C 

0 

24 

25 

1.46 

0.22 

1.27 

-0.21 

BMW 

3 

1MD217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

5 

1G223 

* 

-1 

1819 

96 

1.53 

0.03 

0.00 

0.02 

BMW 

5 

1G223 

A 

1 

69 

92 

1.58 

0.14 

0.85 

0.44 

BMW 

5 

1G223 

B 

0 

6 

8 

-0.50 

0.33 

0.37 

-0.44 

BMW 

5 

1G223 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

5 

1G223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

7 

1G24 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

BMW 

7 

1G24 

A 

1 

64 

89 

2.09 

0.13 

0.96 

0.37 

BMW 

7 

1G24 

B 

0 

6 

8 

0.40 

0.23 

0.39 

-0.43 

BMW 

7 

1G24 

C 

0 

2 

3 

2.00 

0.49 

1.83 

0.01 

BMW 

7 

1G24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

8 

31012 

* 

-1 

1864 

98 

1.53 

0.03 

0.00 

0.02 

BMW 

8 

31012 

A 

1 

21 

70 

1.85 

0.32 

0.92 

0.53 

BMW 

8 

31012 

B 

0 

3 

10 

-0.51 

0.52 

0.32 

-0.39 

BMW 

8 

31012 

C 

0 

4 

13 

0.34 

0.36 

0.71 

-0.25 

BMW 

8 

31012 

D 

0 

2 

7 

0.37 

1.41 

1.37 

-0.16 

BMW 

9 

1G337 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

BMW 

9 

1G337 

A 

1 

49 

60 

1.75 

0.16 

1.04 

0.33 

BMW 

9 

1G337 

B 

0 

24 

30 

1.10 

0.17 

1.13 

-0.22 

BMW 

9 

1G337 

C 

0 

8 

10 

0.78 

0.42 

1.16 

-0.21 

BMW 

9 

1G337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

11 

10095 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.04 

BMW 

11 

10095 

A 

1 

19 

86 

2.47 

0.32 

0.65 

0.63 

BMW 

11 

10095 

B 

0 

1 

5 

-0.21 

0.00 

0.27 

-0.31 

BMW 

11 

10095 

C 

0 

1 

5 

-0.66 

0.00 

0.17 

-0.37 

BMW 

11 

10095 

D 

0 

1 

5 

-0.47 

0.00 

0.21 

-0.35 

BMW 

12 

10A413 

* 

-1 

1748 

92 

1.52 

0.03 

0.00 

-0.02 

BMW 

12 

10A413 

A 

1 

118 

81 

1.87 

0.10 

1.16 

0.44 

BMW 

12 

10A413 

B 

0 

12 

8 

0.31 

0.21 

0.50 

-0.33 

BMW 

12 

10A413 

C 

0 

16 

11 

0.70 

0.20 

0.81 

-0.27 

BMW 

12 

10A413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

13 

10A211 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

BMW 

13 

10A211 

A 

1 

60 

75 

1.95 

0.14 

0.96 

0.43 

BMW 

13 

10A211 

B 

0 

13 

16 

0.44 

0.26 

0.58 

-0.45 

BMW 

13 

10A211 

C 

0 

7 

9 

1.34 

0.32 

1.47 

-0.08 

BMW 

13 

10A211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

14 

1NBT619 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

BMW 

14 

1NBT619 

A 

1 

50 

71 

2.40 

0.19 

0.99 

0.51 

BMW 

14 

1NBT619 

B 

0 

10 

14 

0.73 

0.28 

0.64 

-0.36 

BMW 

14 

1NBT619 

C 

0 

10 

14 

0.96 

0.24 

0.71 

-0.30 

BMW 

14 

1NBT619 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

16 

1NBT522 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

BMW 

16 

1NBT522 

A 

1 

47 

55 

2.04 

0.16 

0.83 

0.52 

BMW 

16 

1NBT522 

B 

0 

8 

9 

0.45 

0.25 

0.51 

-0.28 

BMW 

16 

1NBT522 

C 

0 

31 

36 

0.87 

0.18 

1.22 

-0.38 

BMW 

16 

1NBT522 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

17 

1NBT540 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

BMW 

17 

1NBT540 

A 

1 

41 

59 

2.54 

0.20 

1.01 

0.51 

BMW 

17 

1NBT540 

B 

0 

16 

23 

1.00 

0.24 

0.77 

-0.38 

BMW 

17 

1NBT540 

C 

0 

13 

19 

1.30 

0.33 

1.37 

-0.23 

BMW 

17 

1NBT540 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

18 

1MD313 

* 

-1 

1823 

96 

1.52 

0.03 

0.00 

-0.03 

BMW 

18 

1MD313 

A 

1 

52 

73 

1.86 

0.12 

1.04 

0.18 

BMW 

18 

1MD313 

B 

0 

17 

24 

1.62 

0.21 

1.45 

-0.09 

BMW 

18 

1MD313 

C 

0 

2 

3 

0.53 

0.16 

0.35 

-0.24 

BMW 

18 

1MD313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

19 

10339 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

BMW 

19 

10339 

A 

1 

20 

87 

1.56 

0.39 

0.97 

0.46 

BMW 

19 

10339 

B 

0 

3 

13 

-0.88 

0.35 

0.36 

-0.46 

BMW 

19 

10339 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

19 

10339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

20 

10003 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

BMW 

20 

10003 

A 

1 

20 

83 

1.27 

0.31 

0.88 

0.51 

BMW 

20 

10003 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

20 

10003 

C 

0 

3 

13 

-0.66 

0.74 

0.58 

-0.40 

BMW 

20 

10003 

D 

0 

1 

4 

-1.22 

0.00 

0.22 

-0.30 

BMW 

21 

10366 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

BMW 

21 

10366 

A 

1 

18 

78 

1.48 

0.30 

0.84 

0.46 

BMW 

21 

10366 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

21 

10366 

C 

0 

1 

4 

2.80 

0.00 

9.54 

0.22 

BMW 

21 

10366 

D 

0 

4 

17 

-1.10 

0.87 

0.52 

-0.62 

BMW 

23 

10285 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

BMW 

23 

10285 

A 

1 

15 

65 

1.37 

0.34 

1.11 

0.34 

BMW 

23 

10285 

B 

0 

2 

9 

1.18 

0.11 

1.42 

0.03 

BMW 

23 

10285 

C 

0 

2 

9 

-0.14 

0.04 

0.38 

-0.28 

BMW 

23 

10285 

D 

0 

4 

17 

0.39 

0.85 

1.46 

-0.23 

BMW 

24 

10227 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.03 

BMW 

24 

10227 

A 

1 

15 

68 

2.47 

0.30 

0.68 

0.64 

BMW 

24 

10227 

B 

0 

2 

9 

0.73 

0.46 

0.52 

-0.25 

BMW 

24 

10227 

C 

0 

3 

14 

0.50 

1.01 

0.86 

-0.38 

BMW 

24 

10227 

D 

0 

2 

9 

0.35 

0.17 

0.32 

-0.33 

BMW 

25 

30618 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.03 

BMW 

25 

30618 

A 

1 

9 

47 

1.96 

0.34 

0.95 

0.60 

BMW 

25 

30618 

B 

0 

4 

21 

0.78 

0.54 

0.90 

-0.16 

BMW 

25 

30618 

C 

0 

3 

16 

0.66 

0.23 

0.58 

-0.17 

BMW 

25 

30618 

D 

0 

3 

16 

-0.21 

0.92 

0.40 

-0.47 


Note. BMW = Benchmark Winter. 



easyCBM CCSS First Grade Math Measure Development 


147 

Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

26 

2G18 

* 

-1 

3918 

98 

1.52 

0.02 

0.00 

0.01 

BMW 

26 

2G18 

A 

1 

65 

88 

1.46 

0.15 

1.15 

0.13 

BMW 

26 

2G18 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

26 

2G18 

C 

0 

9 

12 

0.99 

0.21 

1.26 

-0.13 

BMW 

26 

2G18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

27 

23057 

* 

-1 

3948 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

27 

23057 

A 

1 

36 

82 

1.79 

0.17 

0.73 

0.61 

BMW 

27 

23057 

B 

0 

2 

5 

-0.79 

0.52 

0.19 

-0.38 

BMW 

27 

23057 

C 

0 

5 

11 

0.19 

0.54 

0.88 

-0.35 

BMW 

27 

23057 

D 

0 

1 

2 

-1.06 

0.00 

0.13 

-0.30 

BMW 

28 

22215 

* 

-1 

3949 

99 

1.52 

0.02 

0.00 

0.01 

BMW 

28 

22215 

A 

1 

29 

67 

1.97 

0.27 

0.85 

0.48 

BMW 

28 

22215 

B 

0 

6 

14 

0.28 

0.36 

0.70 

-0.30 

BMW 

28 

22215 

C 

0 

1 

2 

-0.03 

0.00 

0.37 

-0.14 

BMW 

28 

22215 

D 

0 

7 

16 

0.44 

0.68 

1.89 

-0.28 

BMW 

29 

21883 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMW 

29 

21883 

A 

1 

27 

60 

1.91 

0.26 

1.04 

0.50 

BMW 

29 

21883 

B 

0 

6 

13 

0.67 

0.57 

1.13 

-0.17 

BMW 

29 

21883 

C 

0 

7 

16 

0.26 

0.28 

0.53 

-0.30 

BMW 

29 

21883 

D 

0 

5 

11 

0.24 

0.84 

1.14 

-0.25 

BMW 

30 

22181 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.00 

BMW 

30 

22181 

A 

1 

22 

49 

2.20 

0.29 

0.96 

0.47 

BMW 

30 

22181 

B 

0 

5 

11 

0.33 

0.41 

0.47 

-0.31 

BMW 

30 

22181 

C 

0 

14 

31 

1.03 

0.34 

1.17 

-0.24 

BMW 

30 

22181 

D 

0 

4 

9 

1.14 

0.41 

0.95 

-0.09 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMW 

31 

K0158 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

BMW 

31 

K0158 

A 

1 

16 

94 

1.96 

0.37 

1.05 

0.19 

BMW 

31 

K0158 

B 

0 

1 

6 

0.80 

0.00 

0.75 

-0.19 

BMW 

31 

K0158 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

31 

K0158 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

32 

KOI 20 

* 

-1 

1302 

99 

1.38 

0.04 

0.00 

-0.04 

BMW 

32 

KOI 20 

A 

1 

15 

88 

1.99 

0.36 

0.97 

0.28 

BMW 

32 

KOI 20 

B 

0 

1 

6 

0.17 

0.00 

0.36 

-0.31 

BMW 

32 

KOI 20 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

32 

KOI 20 

D 

0 

1 

6 

1.45 

0.00 

1.28 

-0.08 

BMW 

33 

K0334 

* 

-1 

1300 

99 

1.38 

0.04 

0.00 

-0.01 

BMW 

33 

K0334 

A 

1 

13 

68 

2.32 

0.47 

0.80 

0.62 

BMW 

33 

K0334 

B 

0 

4 

21 

-0.09 

0.55 

0.66 

-0.47 

BMW 

33 

K0334 

C 

0 

2 

11 

-0.15 

0.00 

0.38 

-0.32 

BMW 

33 

K0334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

34 

KOA113 

* 

-1 

1269 

96 

1.37 

0.04 

0.00 

-0.03 

BMW 

34 

KOA113 

A 

1 

30 

60 

1.87 

0.19 

1.18 

0.30 

BMW 

34 

KOA113 

B 

0 

4 

8 

0.91 

0.44 

0.67 

-0.20 

BMW 

34 

KOA113 

C 

0 

16 

32 

1.30 

0.26 

1.43 

-0.20 

BMW 

34 

KOA113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMW 

35 

KOA514 

* 

-1 

1220 

92 

1.38 

0.04 

0.00 

-0.01 

BMW 

35 

KOA514 

A 

1 

26 

26 

2.18 

0.28 

1.32 

0.43 

BMW 

35 

KOA514 

B 

0 

47 

47 

1.27 

0.11 

0.94 

-0.14 

BMW 

35 

KOA514 

C 

0 

26 

26 

0.94 

0.14 

0.66 

-0.27 

BMW 

35 

KOA514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMW = Benchmark Winter. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

1 

1MD215 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

BMS 

1 

1MD215 

A 

1 

63 

89 

2.05 

0.14 

0.82 

0.50 

BMS 

1 

1MD215 

B 

0 

3 

4 

0.20 

0.52 

0.41 

-0.29 

BMS 

1 

1MD215 

C 

0 

5 

7 

0.13 

0.21 

0.32 

-0.39 

BMS 

1 

1MD215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

2 

1MD119 

* 

-1 

1750 

92 

1.50 

0.03 

0.00 

-0.06 

BMS 

2 

1MD119 

A 

1 

120 

83 

2.01 

0.11 

1.05 

0.36 

BMS 

2 

1MD119 

B 

0 

9 

6 

0.67 

0.19 

0.58 

-0.24 

BMS 

2 

1MD119 

C 

0 

15 

10 

0.90 

0.27 

0.99 

-0.25 

BMS 

2 

1MD119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

3 

1MD121 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

BMS 

3 

1MD121 

A 

1 

39 

54 

2.16 

0.18 

1.38 

0.22 

BMS 

3 

1MD121 

B 

0 

3 

4 

0.94 

0.38 

0.43 

-0.19 

BMS 

3 

1MD121 

C 

0 

30 

42 

1.76 

0.19 

1.38 

-0.14 

BMS 

3 

1MD121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

4 

31200 

* 

-1 

1866 

99 

1.53 

0.03 

0.00 

0.04 

BMS 

4 

31200 

A 

1 

26 

93 

1.22 

0.33 

0.89 

0.26 

BMS 

4 

31200 

B 

0 

2 

7 

-0.45 

1.65 

1.51 

-0.26 

BMS 

4 

31200 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

4 

31200 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

5 

10429 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

BMS 

5 

10429 

A 

1 

21 

91 

1.38 

0.30 

1.27 

0.04 

BMS 

5 

10429 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

5 

10429 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

5 

10429 

D 

0 

2 

9 

1.20 

1.79 

5.39 

-0.04 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

6 

30111 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

BMS 

6 

30111 

A 

1 

19 

86 

1.68 

0.30 

0.92 

0.45 

BMS 

6 

30111 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

6 

30111 

C 

0 

1 

5 

-0.45 

0.00 

0.28 

-0.30 

BMS 

6 

30111 

D 

0 

2 

9 

0.07 

0.71 

0.59 

-0.32 

BMS 

10 

30149 

* 

-1 

1868 

99 

1.52 

0.03 

0.00 

-0.01 

BMS 

10 

30149 

A 

1 

13 

50 

2.48 

0.29 

0.74 

0.61 

BMS 

10 

30149 

B 

0 

8 

31 

0.28 

0.48 

0.54 

-0.64 

BMS 

10 

30149 

C 

0 

3 

12 

1.83 

0.33 

1.31 

0.05 

BMS 

10 

30149 

D 

0 

2 

8 

1.21 

0.11 

0.63 

-0.09 

BMS 

11 

10A212 

* 

-1 

1806 

95 

1.51 

0.03 

0.00 

-0.06 

BMS 

11 

10A212 

A 

1 

78 

89 

2.04 

0.12 

0.96 

0.34 

BMS 

11 

10A212 

B 

0 

6 

7 

0.80 

0.22 

0.55 

-0.28 

BMS 

11 

10A212 

C 

0 

4 

5 

0.97 

0.46 

0.80 

-0.19 

BMS 

11 

10A212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

12 

10062 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

BMS 

12 

10062 

A 

1 

17 

71 

1.81 

0.46 

1.07 

0.47 

BMS 

12 

10062 

B 

0 

1 

4 

-0.95 

0.00 

0.23 

-0.26 

BMS 

12 

10062 

C 

0 

6 

25 

0.13 

0.18 

0.75 

-0.37 

BMS 

12 

10062 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

13 

10A414 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

BMS 

13 

10A414 

A 

1 

62 

72 

1.84 

0.14 

0.85 

0.49 

BMS 

13 

10A414 

B 

0 

8 

9 

0.47 

0.45 

0.92 

-0.27 

BMS 

13 

10A414 

C 

0 

16 

19 

0.55 

0.18 

0.71 

-0.37 

BMS 

13 

10A414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

14 

1NBT526 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

BMS 

14 

1NBT526 

A 

1 

50 

71 

2.34 

0.19 

1.02 

0.45 

BMS 

14 

1NBT526 

B 

0 

8 

11 

1.14 

0.34 

0.93 

-0.21 

BMS 

14 

1NBT526 

C 

0 

12 

17 

0.87 

0.28 

0.80 

-0.36 

BMS 

14 

1NBT526 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

15 

10A27 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

BMS 

15 

10A27 

A 

1 

50 

71 

2.50 

0.16 

1.02 

0.46 

BMS 

15 

10A27 

B 

0 

11 

16 

1.23 

0.20 

0.63 

-0.36 

BMS 

15 

10A27 

C 

0 

9 

13 

1.51 

0.22 

0.76 

-0.23 

BMS 

15 

10A27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

16 

1NBT57 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

BMS 

16 

1NBT57 

A 

1 

43 

61 

2.16 

0.19 

1.28 

0.37 

BMS 

16 

1NBT57 

B 

0 

11 

16 

1.17 

0.33 

1.15 

-0.24 

BMS 

16 

1NBT57 

C 

0 

16 

23 

1.32 

0.20 

1.02 

-0.23 

BMS 

16 

1NBT57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

18 

1MD310 

* 

-1 

1746 

92 

1.50 

0.03 

0.00 

-0.07 

BMS 

18 

1MD310 

A 

1 

105 

71 

2.15 

0.11 

0.99 

0.43 

BMS 

18 

1MD310 

B 

0 

19 

13 

0.86 

0.16 

0.59 

-0.34 

BMS 

18 

1MD310 

C 

0 

24 

16 

1.30 

0.14 

0.93 

-0.22 

BMS 

18 

1MD310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

19 

10002 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

BMS 

19 

10002 

A 

1 

21 

88 

1.25 

0.34 

0.95 

0.40 

BMS 

19 

10002 

B 

0 

1 

4 

-0.58 

0.00 

0.42 

-0.21 

BMS 

19 

10002 

C 

0 

2 

8 

-0.66 

0.01 

0.39 

-0.32 

BMS 

19 

10002 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

20 

10211 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.04 

BMS 

20 

10211 

A 

1 

18 

86 

1.08 

0.30 

1.27 

0.28 

BMS 

20 

10211 

B 

0 

3 

14 

0.09 

0.39 

0.77 

-0.28 

BMS 

20 

10211 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

20 

10211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

21 

10377 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

BMS 

21 

10377 

A 

1 

19 

79 

1.56 

0.33 

0.89 

0.50 

BMS 

21 

10377 

B 

0 

2 

8 

0.89 

0.37 

1.53 

-0.05 

BMS 

21 

10377 

C 

0 

1 

4 

-0.94 

0.00 

0.23 

-0.28 

BMS 

21 

10377 

D 

0 

2 

8 

-1.32 

0.40 

0.17 

-0.48 

BMS 

22 

10162 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

BMS 

22 

10162 

A 

1 

17 

74 

1.47 

0.41 

0.90 

0.44 

BMS 

22 

10162 

B 

0 

3 

13 

-0.43 

0.27 

0.44 

-0.36 

BMS 

22 

10162 

C 

0 

2 

9 

0.38 

0.58 

1.08 

-0.13 

BMS 

22 

10162 

D 

0 

1 

4 

-0.26 

0.00 

0.48 

-0.18 

BMS 

24 

30609 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

BMS 

24 

30609 

A 

1 

12 

55 

2.17 

0.47 

0.97 

0.64 

BMS 

24 

30609 

B 

0 

3 

14 

0.18 

0.20 

0.51 

-0.24 

BMS 

24 

30609 

C 

0 

2 

9 

0.53 

0.07 

0.69 

-0.12 

BMS 

24 

30609 

D 

0 

5 

23 

-0.32 

0.50 

0.43 

-0.49 

BMS 

25 

10207 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

BMS 

25 

10207 

A 

1 

13 

54 

2.34 

0.37 

0.76 

0.55 

BMS 

25 

10207 

B 

0 

5 

21 

1.02 

0.60 

1.38 

-0.23 

BMS 

25 

10207 

C 

0 

2 

8 

1.42 

0.39 

1.05 

-0.05 

BMS 

25 

10207 

D 

0 

4 

17 

0.26 

0.42 

0.40 

-0.44 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

26 

2G327 

* 

-1 

3924 

98 

1.51 

0.02 

0.00 

-0.05 

BMS 

26 

2G327 

A 

1 

62 

91 

2.20 

0.17 

0.85 

0.34 

BMS 

26 

2G327 

B 

0 

1 

1 

-0.19 

0.00 

0.22 

-0.19 

BMS 

26 

2G327 

C 

0 

5 

7 

0.62 

0.81 

1.46 

-0.28 

BMS 

26 

2G327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

27 

23333 

* 

-1 

3947 

99 

1.52 

0.02 

0.00 

0.02 

BMS 

27 

23333 

A 

1 

35 

78 

1.64 

0.24 

0.89 

0.51 

BMS 

27 

23333 

B 

0 

3 

7 

-0.34 

0.93 

0.83 

-0.28 

BMS 

27 

23333 

C 

0 

4 

9 

-0.11 

0.48 

0.64 

-0.28 

BMS 

27 

23333 

D 

0 

3 

7 

-0.27 

0.36 

0.45 

-0.26 

BMS 

28 

22110 

* 

-1 

3949 

99 

1.51 

0.02 

0.00 

-0.01 

BMS 

28 

22110 

A 

1 

30 

70 

2.34 

0.29 

0.82 

0.56 

BMS 

28 

22110 

B 

0 

5 

12 

-0.45 

0.30 

0.28 

-0.44 

BMS 

28 

22110 

C 

0 

7 

16 

0.84 

0.51 

2.41 

-0.21 

BMS 

28 

22110 

D 

0 

1 

2 

-1.01 

0.00 

0.13 

-0.24 

BMS 

29 

2NBT33 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

BMS 

29 

2NBT33 

A 

1 

50 

76 

2.60 

0.17 

0.93 

0.44 

BMS 

29 

2NBT33 

B 

0 

4 

6 

0.49 

0.50 

0.39 

-0.34 

BMS 

29 

2NBT33 

C 

0 

12 

18 

1.49 

0.34 

1.22 

-0.28 

BMS 

29 

2NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

30 

2NBT33 

* 

-1 

3926 

98 

1.50 

0.02 

0.00 

-0.07 

BMS 

30 

2NBT33 

A 

1 

50 

76 

2.60 

0.17 

0.93 

0.44 

BMS 

30 

2NBT33 

B 

0 

4 

6 

0.49 

0.50 

0.39 

-0.34 

BMS 

30 

2NBT33 

C 

0 

12 

18 

1.49 

0.34 

1.22 

-0.28 

BMS 

30 

2NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix C: Distractor by Form 


Form 

Item Number 

Item ID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

BMS 

31 

K0026 

* 

-1 

1199 

91 

1.36 

0.04 

0.00 

-0.06 

BMS 

31 

K0026 

A 

1 

112 

93 

1.77 

0.11 

0.95 

0.32 

BMS 

31 

K0026 

B 

0 

3 

3 

0.71 

0.17 

0.74 

-0.12 

BMS 

31 

K0026 

C 

0 

4 

3 

-0.33 

0.81 

0.52 

-0.29 

BMS 

31 

K0026 

D 

0 

1 

1 

0.29 

0.00 

0.47 

-0.10 

BMS 

32 

K0092 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

0.00 

BMS 

32 

K0092 

A 

1 

15 

83 

1.60 

0.36 

1.04 

0.29 

BMS 

32 

K0092 

B 

0 

2 

11 

0.39 

1.06 

1.01 

-0.28 

BMS 

32 

K0092 

C 

0 

1 

6 

0.95 

0.00 

1.08 

-0.09 

BMS 

32 

K0092 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

33 

K0483 

* 

-1 

1301 

99 

1.38 

0.04 

0.00 

-0.04 

BMS 

33 

K0483 

A 

1 

14 

78 

2.26 

0.34 

0.89 

0.49 

BMS 

33 

K0483 

B 

0 

1 

6 

2.33 

0.00 

2.56 

0.08 

BMS 

33 

K0483 

C 

0 

2 

11 

-0.02 

0.13 

0.25 

-0.50 

BMS 

33 

K0483 

D 

0 

1 

6 

0.36 

0.00 

0.36 

-0.28 

BMS 

34 

30603 

* 

-1 

1303 

99 

1.38 

0.04 

0.00 

-0.02 

BMS 

34 

30603 

A 

1 

10 

63 

2.64 

0.55 

1.12 

0.53 

BMS 

34 

30603 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

BMS 

34 

30603 

C 

0 

3 

19 

-1.29 

1.93 

0.59 

-0.60 

BMS 

34 

30603 

D 

0 

3 

19 

1.40 

0.84 

1.68 

-0.06 

BMS 

35 

KNBT134 

* 

-1 

1271 

96 

1.39 

0.04 

0.00 

0.04 

BMS 

35 

KNBT134 

A 

1 

17 

35 

1.59 

0.19 

0.96 

0.37 

BMS 

35 

KNBT134 

B 

0 

8 

17 

0.88 

0.39 

1.49 

-0.09 

BMS 

35 

KNBT134 

C 

0 

23 

48 

0.77 

0.21 

1.04 

-0.29 

BMS 

35 

KNBT134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 


Note. BMS = Benchmark Spring. 
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Appendix D: Item Statistics 


Appendix D: Item Statistics for Full CCSS Item Bank 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10001 

- 1.72 

23 

21 

0.78 

1.02 

0.21 

0.53 

- 0.21 

0.00 

0.35 

1.06 

10002 

- 1.60 

24 

21 

0.66 

0.89 

- 0.16 

0.47 

- 0.27 

- 0.01 

0.40 

1.17 

10003 

- 1.31 

24 

20 

0.63 

0.90 

- 0.16 

0.55 

- 0.20 

0.00 

0.51 

1.15 

10004 

- 2.34 

24 

23 

1.04 

0.96 

0.24 

0.42 

- 0.06 

0.00 

0.25 

1.06 

10005 

0.00 

24 

24 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10006 

- 1.75 

24 

21 

0.67 

0.73 

- 0.64 

0.36 

- 0.43 

- 0.01 

0.47 

1.31 

10007 

- 1.55 

641 

570 

0.14 

0.99 

- 0.07 

1.30 

1.24 

0.00 

0.35 

0.99 

10008 

0.34 

21 

11 

0.52 

1.62 

2.53 

5.50 

4.28 

0.00 

0.05 

- 1.11 

10009 

0.07 

23 

14 

0.52 

1.35 

1.42 

2.38 

1.85 

0.00 

0.32 

0.12 

10010 

- 0.28 

21 

16 

0.60 

0.73 

- 0.84 

0.46 

- 0.66 

0.00 

0.65 

1.38 

10011 

- 0.56 

24 

20 

0.62 

0.84 

- 0.32 

0.85 

0.02 

- 0.01 

0.52 

1.12 

10012 

- 0.35 

24 

19 

0.54 

1.01 

0.13 

0.86 

0.10 

- 0.01 

0.34 

0.99 

10013 

1.54 

24 

9 

0.51 

0.88 

- 0.50 

0.73 

- 0.73 

0.00 

0.63 

1.31 

10014 

- 0.14 

24 

17 

0.51 

0.96 

- 0.12 

0.73 

- 0.44 

0.00 

0.50 

1.15 

10015 

- 0.66 

24 

19 

0.57 

0.98 

0.03 

0.99 

0.21 

0.00 

0.41 

1.00 

10016 

- 2.06 

23 

21 

1.04 

0.93 

0.21 

0.38 

- 0.11 

0.00 

0.67 

1.08 

10017 

0.17 

23 

16 

0.53 

0.75 

- 1.05 

0.58 

- 0.81 

0.00 

0.63 

1.48 

10018 

- 0.20 

24 

20 

0.61 

1.29 

0.87 

2.06 

1.38 

0.00 

0.18 

0.55 

10019 

0.18 

23 

14 

0.49 

1.03 

0.22 

2.52 

2.47 

- 0.01 

0.37 

0.59 

10020 

1.28 

24 

13 

0.48 

0.85 

- 0.68 

0.82 

- 0.46 

0.00 

0.59 

1.32 

10021 

- 0.66 

23 

18 

0.55 

0.93 

- 0.19 

0.71 

- 0.53 

0.00 

0.40 

1.18 

10022 

- 0.91 

168 

147 

0.25 

0.85 

- 0.90 

0.60 

- 1.23 

0.00 

0.45 

1.14 

10023 

- 0.64 

24 

19 

0.58 

0.88 

- 0.30 

0.54 

- 0.50 

- 0.01 

0.54 

1.22 

10024 

- 0.14 

24 

18 

0.55 

0.87 

- 0.41 

0.68 

- 0.45 

0.00 

0.55 

1.25 

10025 

0.21 

24 

16 

0.51 

1.49 

1.79 

1.65 

1.63 

0.00 

0.20 

0.17 

10026 

2.36 

24 

9 

0.57 

1.32 

1.09 

1.28 

0.68 

0.00 

0.57 

0.60 

10027 

0.53 

22 

13 

0.50 

1.02 

0.19 

0.98 

0.06 

0.00 

0.46 

0.94 

10028 

1.42 

21 

11 

0.52 

1.28 

1.31 

1.49 

1.18 

0.00 

0.35 

0.34 

10029 

- 0.77 

21 

17 

0.63 

0.88 

- 0.32 

0.59 

- 0.04 

- 0.01 

0.47 

1.22 

10030 

1.97 

24 

8 

0.49 

1.41 

1.69 

1.66 

1.78 

0.00 

0.09 

0.20 

10031 

0.33 

23 

14 

0.55 

1.05 

0.28 

1.21 

0.53 

0.00 

0.56 

0.83 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10032 

0.30 

22 

14 

0.51 

1.00 

0.05 

0.87 

- 0.11 

0.00 

0.48 

1.06 

10033 

0.46 

24 

14 

0.49 

0.65 

- 2.20 

0.53 

- 0.99 

0.00 

0.67 

1.94 

10034 

0.09 

23 

16 

0.51 

0.99 

0.03 

0.87 

- 0.19 

0.00 

0.45 

1.05 

10035 

0.55 

24 

14 

0.50 

0.72 

- 1.29 

0.62 

- 1.01 

0.00 

0.67 

1.55 

10036 

1.41 

24 

11 

0.50 

0.78 

- 1.02 

0.67 

- 0.80 

0.00 

0.68 

1.44 

10037 

0.64 

24 

14 

0.51 

1.15 

0.69 

0.96 

0.09 

- 0.01 

0.52 

0.81 

10038 

- 0.11 

24 

17 

0.50 

1.22 

1.08 

1.15 

0.47 

0.00 

0.27 

0.53 

10039 

0.23 

640 

430 

0.10 

0.89 

- 2.60 

0.79 

- 2.37 

0.00 

0.56 

1.22 

10040 

- 0.06 

24 

17 

0.50 

1.17 

0.76 

0.98 

0.11 

0.00 

0.33 

0.79 

10041 

- 0.56 

24 

19 

0.58 

1.56 

1.54 

5.48 

2.99 

0.00 

0.02 

0.01 

10042 

- 0.37 

23 

17 

0.55 

1.07 

0.34 

0.98 

0.09 

0.00 

0.42 

0.91 

10043 

0.40 

24 

16 

0.53 

1.42 

1.56 

1.82 

1.63 

0.00 

0.34 

0.22 

10044 

1.31 

22 

11 

0.55 

0.66 

- 1.51 

0.55 

- 0.95 

0.00 

0.75 

1.64 

10045 

- 0.46 

21 

17 

0.66 

0.99 

0.11 

0.71 

- 0.09 

- 0.01 

0.52 

1.06 

10046 

1.65 

24 

8 

0.51 

1.17 

0.76 

2.62 

2.51 

0.00 

0.35 

0.45 

10047 

1.53 

23 

11 

0.52 

1.30 

1.18 

1.17 

0.53 

0.00 

0.48 

0.56 

10048 

0.21 

24 

15 

0.49 

0.79 

- 0.99 

0.75 

- 0.76 

0.00 

0.60 

1.44 

10049 

0.48 

23 

13 

0.50 

0.83 

- 0.79 

0.70 

- 0.78 

- 0.01 

0.61 

1.41 

10050 

2.75 

24 

5 

0.58 

0.90 

- 0.17 

0.63 

- 0.44 

0.00 

0.56 

1.15 

10051 

- 0.42 

23 

17 

0.56 

0.87 

- 0.41 

0.62 

- 0.42 

0.00 

0.56 

1.25 

10052 

0.34 

24 

15 

0.48 

1.14 

0.86 

1.17 

0.50 

- 0.01 

0.37 

0.56 

10053 

1.20 

23 

12 

0.52 

0.81 

- 0.78 

0.69 

- 0.95 

0.00 

0.67 

1.41 

10054 

1.22 

24 

12 

0.49 

1.20 

1.00 

1.23 

0.83 

0.00 

0.43 

0.52 

10055 

3.50 

23 

7 

0.65 

0.48 

- 1.66 

0.28 

- 0.97 

0.00 

0.85 

1.55 

10056 

2.11 

23 

7 

0.53 

0.97 

- 0.03 

1.61 

1.21 

0.00 

0.47 

0.90 

10057 

- 0.38 

23 

17 

0.53 

0.68 

- 1.34 

0.52 

- 1.21 

0.00 

0.61 

1.55 

10058 

0.03 

24 

16 

0.50 

1.26 

1.30 

1.64 

1.39 

0.00 

0.31 

0.27 

10059 

- 0.48 

178 

150 

0.23 

0.96 

- 0.22 

0.80 

- 0.67 

0.00 

0.42 

1.05 

10060 

- 0.43 

177 

148 

0.22 

0.85 

- 1.12 

0.66 

- 1.39 

0.00 

0.50 

1.17 

10061 

0.42 

23 

14 

0.48 

1.07 

0.40 

0.93 

- 0.11 

0.00 

0.44 

0.93 

10062 

- 0.18 

24 

17 

0.51 

0.99 

0.01 

0.81 

- 0.34 

0.00 

0.47 

1.10 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10063 

- 1.34 

22 

19 

0.67 

1.01 

0.15 

0.76 

0.13 

- 0.01 

0.34 

1.03 

10064 

- 0.15 

22 

16 

0.54 

0.73 

- 1.10 

0.60 

- 0.98 

0.00 

0.56 

1.50 

10065 

- 1.54 

169 

153 

0.28 

0.87 

- 0.63 

0.82 

- 0.38 

0.00 

0.37 

1.08 

10066 

0.18 

24 

15 

0.51 

1.11 

0.54 

1.00 

0.16 

0.00 

0.51 

0.83 

10067 

1.94 

24 

8 

0.49 

1.10 

0.49 

0.97 

0.11 

0.00 

0.42 

0.87 

10068 

2.08 

181 

73 

0.17 

0.85 

- 2.30 

0.82 

- 1.74 

0.00 

0.57 

1.37 

10069 

- 0.65 

172 

148 

0.24 

0.88 

- 0.76 

0.81 

- 0.51 

0.00 

0.43 

1.10 

10070 

1.61 

24 

12 

0.56 

1.17 

0.66 

1.30 

0.68 

0.00 

0.59 

0.72 

10071 

- 0.40 

22 

17 

0.57 

1.08 

0.37 

0.88 

0.03 

- 0.01 

0.38 

0.93 

10072 

1.54 

23 

9 

0.50 

1.09 

0.45 

1.95 

2.05 

- 0.01 

0.41 

0.58 

10073 

- 0.65 

23 

19 

0.61 

0.67 

- 1.06 

0.43 

- 0.60 

- 0.01 

0.54 

1.45 

10074 

0.58 

22 

14 

0.51 

0.91 

- 0.30 

0.86 

- 0.31 

0.00 

0.55 

1.17 

10075 

- 1.41 

24 

22 

0.77 

1.10 

0.36 

1.05 

0.44 

- 0.01 

0.17 

0.92 

10076 

- 0.56 

25 

20 

0.59 

0.87 

- 0.33 

0.95 

0.20 

0.00 

0.53 

1.10 

10077 

- 0.45 

24 

20 

0.68 

0.47 

- 1.48 

0.26 

- 1.05 

0.00 

0.71 

1.49 

10078 

- 1.92 

23 

21 

0.93 

0.95 

0.19 

2.40 

1.19 

0.00 

0.41 

0.87 

10079 

- 0.84 

24 

20 

0.61 

1.15 

0.53 

1.07 

0.37 

0.00 

0.30 

0.83 

10080 

0.00 

20 

20 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10081 

- 1.41 

24 

21 

0.68 

1.21 

0.60 

1.02 

0.36 

- 0.01 

0.29 

0.85 

10082 

- 2.08 

23 

21 

0.81 

0.89 

- 0.03 

0.60 

0.07 

- 0.01 

0.43 

1.08 

10083 

- 1.32 

24 

21 

0.66 

1.13 

0.44 

1.27 

0.58 

- 0.01 

0.21 

0.85 

10084 

- 1.41 

24 

22 

0.77 

1.01 

0.20 

0.88 

0.36 

- 0.01 

0.23 

0.99 

10085 

2.10 

25 

9 

0.51 

0.94 

- 0.19 

0.82 

- 0.35 

0.00 

0.61 

1.13 

10086 

1.52 

23 

10 

0.47 

1.21 

1.10 

1.15 

0.59 

0.00 

0.30 

0.52 

10087 

0.62 

24 

15 

0.53 

1.07 

0.33 

0.89 

- 0.01 

0.00 

0.58 

0.95 

10088 

- 0.50 

24 

18 

0.54 

1.14 

0.66 

2.32 

1.72 

- 0.01 

0.33 

0.58 

10089 

- 1.86 

25 

23 

0.79 

0.89 

- 0.05 

0.36 

- 0.15 

- 0.01 

0.38 

1.15 

10090 

1.06 

23 

15 

0.51 

0.93 

- 0.24 

1.22 

0.70 

0.00 

0.52 

1.04 

10091 

0.56 

22 

15 

0.51 

0.64 

- 1.86 

0.51 

- 1.38 

0.00 

0.69 

1.77 

10092 

0.20 

23 

16 

0.50 

1.17 

0.83 

1.34 

0.90 

0.00 

0.25 

0.57 

10093 

1.42 

25 

11 

0.51 

1.29 

1.17 

1.28 

0.80 

0.00 

0.48 

0.56 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10094 

1.05 

640 

341 

0.10 

1.05 

1.25 

1.08 

1.05 

0.00 

0.51 

0.89 

10095 

- 0.56 

22 

19 

0.70 

0.55 

- 1.28 

0.28 

- 0.56 

- 0.01 

0.63 

1.48 

10096 

- 0.79 

24 

18 

0.57 

0.82 

- 0.57 

0.71 

- 0.14 

- 0.01 

0.58 

1.22 

10097 

0.16 

24 

17 

0.52 

0.96 

- 0.09 

0.78 

- 0.45 

0.00 

0.51 

1.14 

10098 

- 0.28 

23 

16 

0.53 

0.89 

- 0.38 

0.82 

- 0.17 

0.00 

0.56 

1.17 

10099 

- 1.18 

24 

21 

0.65 

0.79 

- 0.41 

0.46 

- 0.24 

0.00 

0.43 

1.23 

10100 

0.11 

22 

15 

0.58 

1.11 

0.49 

1.15 

0.44 

- 0.01 

0.54 

0.82 

10101 

0.03 

24 

17 

0.51 

0.73 

- 1.22 

0.72 

- 0.48 

- 0.01 

0.60 

1.43 

10102 

0.95 

24 

17 

0.54 

1.24 

0.89 

1.15 

0.49 

0.00 

0.44 

0.69 

10103 

- 0.21 

193 

151 

0.19 

0.99 

- 0.03 

1.05 

0.35 

0.00 

0.35 

1.00 

10104 

0.49 

24 

14 

0.47 

1.04 

0.28 

0.98 

0.04 

0.00 

0.44 

0.93 

10105 

0.21 

24 

16 

0.52 

0.83 

- 0.73 

0.65 

- 0.91 

0.00 

0.60 

1.40 

10106 

- 0.75 

24 

20 

0.63 

0.55 

- 1.48 

0.29 

- 0.74 

- 0.01 

0.65 

1.49 

10107 

0.22 

24 

17 

0.53 

0.65 

- 1.63 

0.44 

- 0.94 

- 0.01 

0.68 

1.61 

10108 

- 0.10 

22 

16 

0.57 

0.74 

- 0.83 

0.56 

- 0.65 

0.00 

0.67 

1.34 

10109 

- 0.71 

22 

19 

0.67 

1.25 

0.71 

1.05 

0.39 

- 0.01 

0.22 

0.78 

10110 

- 0.31 

24 

17 

0.50 

1.18 

0.89 

1.15 

0.44 

- 0.01 

0.32 

0.62 

10111 

- 0.97 

23 

18 

0.60 

0.58 

- 1.50 

0.37 

- 0.59 

- 0.01 

0.65 

1.53 

10112 

1.60 

23 

10 

0.50 

0.66 

- 1.58 

0.55 

- 1.59 

0.00 

0.75 

1.63 

10113 

0.17 

24 

16 

0.51 

0.86 

- 0.66 

0.74 

- 0.60 

- 0.01 

0.58 

1.33 

10114 

0.00 

23 

15 

0.49 

1.20 

1.02 

1.48 

1.24 

- 0.01 

0.23 

0.44 

10115 

- 0.16 

20 

12 

0.52 

1.02 

0.17 

0.89 

- 0.17 

0.00 

0.48 

1.02 

10116 

- 0.07 

24 

17 

0.51 

0.90 

- 0.36 

0.73 

- 0.40 

0.00 

0.52 

1.22 

10117 

1.43 

24 

12 

0.47 

1.08 

0.46 

1.00 

0.10 

0.00 

0.44 

0.85 

10118 

- 0.04 

24 

15 

0.52 

1.31 

1.25 

2.81 

2.38 

0.00 

0.38 

0.31 

10119 

3.86 

23 

5 

0.72 

0.69 

- 0.76 

0.30 

- 0.32 

0.00 

0.75 

1.34 

10120 

0.42 

22 

13 

0.50 

1.18 

0.88 

1.21 

0.71 

0.00 

0.36 

0.61 

10121 

1.26 

23 

11 

0.52 

0.91 

- 0.26 

1.15 

0.50 

0.00 

0.61 

1.04 

10122 

0.82 

24 

12 

0.49 

1.07 

0.39 

0.88 

- 0.14 

0.00 

0.54 

0.94 

10123 

1.05 

24 

13 

0.47 

0.86 

- 0.72 

0.83 

- 0.46 

0.00 

0.57 

1.34 

10124 

- 0.40 

22 

18 

0.60 

0.90 

- 0.21 

0.58 

- 0.42 

- 0.01 

0.48 

1.18 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10125 

0.54 

24 

15 

0.50 

0.99 

0.03 

1.16 

0.51 

0.00 

0.49 

0.95 

10126 

0.62 

23 

14 

0.51 

0.87 

- 0.54 

0.69 

- 0.55 

0.00 

0.59 

1.31 

10127 

0.17 

22 

15 

0.52 

1.27 

1.12 

1.25 

0.73 

0.00 

0.26 

0.54 

10128 

1.35 

170 

92 

0.17 

1.02 

0.29 

0.97 

- 0.29 

0.00 

0.45 

0.98 

10129 

0.62 

24 

13 

0.47 

0.98 

- 0.04 

0.90 

- 0.18 

0.00 

0.51 

1.08 

10130 

0.87 

22 

11 

0.52 

0.60 

- 1.87 

0.48 

- 1.19 

0.00 

0.76 

1.75 

10131 

1.14 

23 

11 

0.49 

1.42 

1.79 

1.54 

1.71 

0.00 

0.26 

0.07 

10132 

1.11 

24 

10 

0.48 

1.29 

1.35 

1.39 

1.26 

0.00 

0.31 

0.33 

10133 

0.44 

202 

146 

0.18 

0.97 

- 0.33 

1.04 

0.29 

0.00 

0.43 

1.03 

10134 

0.00 

22 

15 

0.54 

1.04 

0.24 

0.92 

0.02 

- 0.01 

0.49 

0.96 

10135 

0.87 

189 

119 

0.17 

0.96 

- 0.59 

0.89 

- 0.92 

0.00 

0.49 

1.12 

10136 

1.35 

168 

96 

0.18 

1.02 

0.28 

0.96 

- 0.30 

0.00 

0.47 

0.98 

10137 

1.25 

23 

12 

0.50 

1.09 

0.46 

0.88 

- 0.22 

0.00 

0.54 

0.94 

10138 

0.04 

23 

15 

0.53 

0.79 

- 0.98 

0.57 

- 0.48 

- 0.01 

0.63 

1.46 

10139 

- 0.44 

24 

19 

0.59 

0.76 

- 0.77 

0.58 

- 0.57 

0.00 

0.57 

1.30 

10140 

1.29 

24 

11 

0.49 

0.70 

- 1.47 

0.60 

- 1.57 

0.00 

0.63 

1.67 

10141 

0.48 

23 

15 

0.53 

0.67 

- 1.41 

0.57 

- 1.19 

0.00 

0.69 

1.57 

10142 

0.19 

173 

134 

0.20 

0.90 

- 0.96 

0.75 

- 1.26 

0.00 

0.48 

1.16 

10143 

- 0.29 

23 

18 

0.56 

0.83 

- 0.67 

0.57 

- 0.53 

- 0.01 

0.49 

1.36 

10144 

0.00 

23 

23 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10145 

- 1.12 

101 

89 

0.35 

1.01 

0.10 

0.95 

0.05 

0.00 

0.40 

0.99 

10146 

- 1.62 

22 

20 

0.80 

0.76 

- 0.32 

0.29 

- 0.25 

- 0.01 

0.49 

1.23 

10147 

- 2.55 

25 

24 

1.04 

0.79 

0.04 

0.22 

- 0.36 

0.00 

0.40 

1.15 

10148 

- 0.60 

20 

16 

0.61 

0.95 

- 0.06 

0.66 

- 0.23 

0.00 

0.42 

1.14 

10149 

- 0.19 

24 

18 

0.54 

0.86 

- 0.56 

0.58 

- 0.60 

- 0.01 

0.55 

1.31 

10150 

0.63 

17 

10 

0.57 

1.03 

0.20 

0.93 

- 0.01 

0.00 

0.47 

0.97 

10151 

2.31 

170 

62 

0.18 

1.04 

0.50 

1.69 

3.91 

0.00 

0.40 

0.78 

10152 

1.47 

171 

93 

0.18 

1.25 

3.31 

1.33 

2.94 

0.00 

0.29 

0.36 

10153 

2.27 

24 

8 

0.60 

1.75 

1.82 

2.17 

1.88 

0.00 

0.41 

0.16 

10154 

1.99 

24 

10 

0.55 

2.18 

3.61 

2.67 

1.56 

0.00 

0.23 

- 1.11 

10155 

1.38 

24 

10 

0.50 

0.61 

- 1.96 

0.48 

- 1.15 

0.00 

0.73 

1.75 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10156 

2.13 

23 

9 

0.56 

1.80 

2.53 

2.05 

1.72 

0.00 

0.34 

- 0.31 

10157 

1.58 

24 

11 

0.46 

1.31 

1.57 

1.94 

2.71 

0.00 

0.15 

- 0.01 

10158 

2.22 

24 

8 

0.53 

1.29 

1.09 

1.69 

1.44 

0.00 

0.38 

0.49 

10159 

1.43 

24 

13 

0.52 

0.91 

- 0.27 

1.03 

0.20 

0.00 

0.59 

1.09 

10160 

1.39 

27 

11 

0.45 

1.62 

2.60 

2.07 

3.03 

0.00 

0.11 

- 0.37 

10161 

- 1.28 

24 

22 

0.78 

0.86 

- 0.08 

0.40 

- 0.34 

- 0.01 

0.38 

1.16 

10162 

- 0.45 

23 

17 

0.52 

0.86 

- 0.59 

0.73 

- 0.66 

0.00 

0.44 

1.32 

10163 

- 0.74 

23 

19 

0.59 

1.16 

0.61 

1.12 

0.40 

- 0.01 

0.25 

0.79 

10164 

- 0.49 

23 

17 

0.55 

0.77 

- 0.75 

0.83 

- 0.09 

0.00 

0.56 

1.26 

10165 

0.49 

24 

14 

0.49 

1.04 

0.28 

0.88 

- 0.20 

0.00 

0.52 

0.99 

10166 

1.27 

189 

116 

0.17 

1.01 

0.20 

0.98 

- 0.09 

0.00 

0.45 

0.98 

10167 

0.93 

24 

12 

0.52 

0.87 

- 0.41 

1.18 

0.56 

0.00 

0.64 

1.10 

10168 

1.22 

24 

12 

0.48 

1.12 

0.69 

1.17 

0.75 

0.00 

0.46 

0.62 

10169 

0.48 

24 

15 

0.51 

1.26 

1.08 

1.29 

0.71 

0.00 

0.41 

0.57 

10170 

2.40 

167 

64 

0.18 

0.99 

- 0.12 

1.06 

0.47 

0.00 

0.49 

0.99 

10171 

0.76 

24 

15 

0.51 

1.14 

0.69 

0.94 

0.02 

- 0.01 

0.51 

0.82 

10172 

1.79 

23 

7 

0.51 

1.31 

1.25 

1.49 

1.28 

0.00 

0.18 

0.45 

10173 

1.63 

187 

93 

0.17 

1.09 

1.34 

1.04 

0.43 

0.00 

0.42 

0.79 

10174 

0.75 

24 

11 

0.47 

1.15 

0.85 

1.49 

1.38 

0.00 

0.36 

0.43 

10175 

0.77 

23 

14 

0.48 

1.25 

1.17 

1.14 

0.55 

0.00 

0.29 

0.54 

10176 

1.22 

24 

11 

0.51 

1.01 

0.10 

0.84 

- 0.23 

0.00 

0.59 

1.04 

10177 

3.42 

24 

6 

0.61 

2.14 

2.96 

8.63 

3.35 

0.00 

- 0.02 

- 1.24 

10178 

2.76 

24 

6 

0.54 

1.17 

0.69 

2.00 

1.43 

0.00 

0.31 

0.63 

10179 

- 0.17 

22 

16 

0.60 

0.75 

- 0.81 

0.49 

- 0.45 

0.00 

0.66 

1.38 

10180 

- 1.24 

23 

21 

0.79 

0.89 

- 0.03 

0.39 

- 0.25 

- 0.01 

0.45 

1.14 

10181 

0.89 

24 

10 

0.48 

1.13 

0.71 

1.13 

0.46 

0.00 

0.40 

0.72 

10182 

0.18 

22 

14 

0.51 

0.89 

- 0.47 

0.73 

- 0.59 

0.00 

0.54 

1.29 

10183 

0.13 

21 

11 

0.53 

0.92 

- 0.28 

0.75 

- 0.31 

0.00 

0.60 

1.22 

10184 

0.45 

22 

13 

0.49 

1.25 

1.23 

1.31 

1.11 

0.00 

0.29 

0.36 

10185 

- 0.27 

24 

17 

0.53 

0.72 

- 1.15 

1.27 

0.68 

0.00 

0.58 

1.27 

10186 

1.36 

22 

9 

0.53 

1.24 

1.04 

1.19 

0.61 

0.00 

0.47 

0.57 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10187 

1.68 

23 

12 

0.53 

1.45 

1.64 

1.96 

2.05 

0.00 

0.37 

0.09 

10188 

1.51 

23 

11 

0.53 

0.92 

- 0.26 

0.95 

0.02 

0.00 

0.63 

1.12 

10189 

1.87 

24 

8 

0.52 

0.71 

- 1.20 

0.95 

0.05 

0.00 

0.64 

1.35 

10190 

1.83 

24 

10 

0.49 

0.89 

- 0.47 

0.76 

- 0.43 

0.00 

0.58 

1.26 

10191 

1.21 

22 

13 

0.50 

0.61 

- 2.24 

0.50 

- 1.38 

- 0.01 

0.73 

1.91 

10192 

2.41 

24 

7 

0.53 

0.78 

- 0.88 

0.71 

- 0.46 

0.00 

0.63 

1.31 

10193 

- 0.15 

24 

17 

0.50 

0.75 

- 1.20 

0.55 

- 0.97 

- 0.01 

0.63 

1.50 

10194 

0.92 

24 

14 

0.53 

1.00 

0.10 

0.93 

- 0.02 

0.00 

0.61 

1.01 

10195 

- 0.14 

23 

17 

0.54 

0.88 

- 0.33 

1.04 

0.23 

0.00 

0.53 

1.09 

10196 

- 0.19 

25 

19 

0.58 

0.83 

- 0.49 

0.56 

- 0.56 

0.00 

0.62 

1.26 

10197 

- 0.88 

23 

19 

0.63 

1.17 

0.55 

1.08 

0.38 

0.00 

0.35 

0.83 

10198 

0.81 

24 

13 

0.50 

0.95 

- 0.17 

0.80 

- 0.33 

0.00 

0.59 

1.15 

10199 

0.44 

24 

15 

0.47 

1.08 

0.45 

0.99 

0.09 

0.00 

0.39 

0.86 

10200 

0.41 

24 

16 

0.56 

0.46 

- 2.06 

0.32 

- 1.45 

0.00 

0.83 

1.63 

10201 

- 1.62 

168 

158 

0.34 

0.89 

- 0.36 

0.50 

- 0.95 

0.00 

0.33 

1.09 

10202 

- 2.63 

24 

23 

1.06 

1.01 

0.29 

0.38 

- 0.11 

0.00 

0.28 

1.05 

10203 

- 2.03 

24 

22 

0.82 

0.60 

- 0.63 

0.21 

- 0.38 

- 0.01 

0.54 

1.29 

10204 

1.08 

24 

14 

0.54 

1.15 

0.59 

1.04 

0.25 

0.00 

0.57 

0.83 

10205 

- 2.57 

23 

22 

1.08 

0.61 

- 0.27 

0.14 

- 0.55 

0.00 

0.42 

1.24 

10206 

0.11 

24 

15 

0.50 

1.07 

0.39 

1.24 

0.65 

- 0.01 

0.47 

0.80 

10207 

1.36 

24 

13 

0.47 

0.91 

- 0.46 

0.87 

- 0.41 

0.00 

0.55 

1.25 

10208 

- 0.55 

25 

19 

0.53 

0.91 

- 0.25 

0.65 

- 0.51 

0.00 

0.50 

1.19 

10209 

- 1.51 

171 

155 

0.28 

0.92 

- 0.35 

0.73 

- 0.64 

0.00 

0.36 

1.06 

10210 

- 0.41 

23 

19 

0.59 

0.83 

- 0.45 

0.59 

- 0.53 

- 0.01 

0.46 

1.25 

10211 

- 1.31 

21 

18 

0.68 

1.22 

0.62 

0.84 

0.12 

0.00 

0.28 

0.89 

10212 

- 0.11 

22 

17 

0.57 

1.25 

0.99 

1.43 

0.78 

0.00 

0.28 

0.53 

10213 

- 0.73 

23 

19 

0.63 

0.86 

- 0.39 

0.63 

- 0.15 

- 0.01 

0.49 

1.20 

10214 

- 1.83 

24 

22 

0.78 

0.89 

- 0.03 

0.41 

- 0.35 

0.00 

0.36 

1.14 

10215 

- 1.76 

23 

21 

0.79 

1.15 

0.45 

1.12 

0.55 

- 0.01 

0.22 

0.87 

10216 

- 0.08 

169 

137 

0.21 

1.02 

0.18 

0.91 

- 0.31 

0.00 

0.37 

1.00 

10217 

0.58 

24 

16 

0.49 

1.29 

1.30 

1.38 

1.09 

0.00 

0.25 

0.39 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10218 

- 0.17 

24 

18 

0.60 

0.95 

- 0.06 

0.80 

0.02 

0.00 

0.61 

1.06 

10219 

- 0.51 

23 

17 

0.53 

1.07 

0.37 

1.90 

1.29 

- 0.01 

0.30 

0.65 

10220 

- 1.33 

21 

17 

0.68 

0.91 

- 0.09 

0.49 

- 0.39 

0.00 

0.63 

1.17 

10221 

- 1.95 

24 

22 

0.82 

1.02 

0.22 

2.33 

1.17 

- 0.01 

0.25 

0.81 

10222 

0.26 

24 

16 

0.51 

0.71 

- 1.72 

0.60 

- 1.23 

- 0.01 

0.62 

1.83 

10223 

- 0.23 

24 

18 

0.52 

0.80 

- 0.87 

0.56 

- 0.65 

- 0.01 

0.55 

1.39 

10224 

- 0.01 

24 

18 

0.52 

1.28 

1.07 

1.06 

0.28 

0.00 

0.25 

0.68 

10225 

0.72 

202 

139 

0.17 

0.98 

- 0.26 

0.92 

- 0.48 

0.00 

0.45 

1.05 

10226 

0.70 

24 

14 

0.50 

0.65 

- 1.52 

0.62 

- 0.96 

0.00 

0.73 

1.53 

10227 

0.81 

22 

15 

0.53 

0.75 

- 1.09 

0.63 

- 0.89 

0.00 

0.64 

1.46 

10228 

1.54 

24 

12 

0.47 

0.77 

- 1.31 

0.64 

- 1.29 

0.00 

0.66 

1.61 

10229 

0.54 

26 

18 

0.51 

0.84 

- 0.62 

0.63 

- 0.84 

0.00 

0.62 

1.30 

10230 

0.41 

170 

124 

0.19 

0.87 

- 1.46 

0.72 

- 1.54 

0.00 

0.53 

1.24 

10231 

- 1.53 

23 

20 

0.68 

1.16 

0.52 

1.07 

0.47 

- 0.01 

0.26 

0.82 

10232 

0.37 

23 

14 

0.53 

1.17 

0.75 

1.00 

0.14 

0.00 

0.51 

0.77 

10233 

- 0.08 

173 

140 

0.21 

0.91 

- 0.77 

0.69 

- 1.41 

0.00 

0.45 

1.14 

10234 

0.79 

23 

13 

0.49 

0.56 

- 2.50 

0.48 

- 1.86 

0.00 

0.69 

1.99 

10235 

0.01 

24 

16 

0.51 

0.97 

- 0.04 

0.87 

- 0.13 

0.00 

0.51 

1.08 

10236 

1.13 

22 

13 

0.54 

0.58 

- 2.05 

0.49 

- 1.48 

0.00 

0.74 

1.86 

10237 

1.03 

23 

14 

0.50 

0.92 

- 0.30 

0.87 

- 0.28 

0.00 

0.55 

1.17 

10238 

- 0.94 

176 

158 

0.27 

1.07 

0.43 

1.11 

0.41 

0.00 

0.26 

0.95 

10239 

0.78 

23 

17 

0.56 

1.14 

0.59 

1.26 

0.68 

0.00 

0.42 

0.73 

10240 

0.04 

24 

18 

0.54 

1.39 

1.44 

1.66 

1.21 

- 0.01 

0.25 

0.35 

10241 

0.36 

24 

18 

0.55 

1.10 

0.52 

0.95 

0.15 

- 0.01 

0.46 

0.86 

10242 

- 0.29 

23 

17 

0.55 

0.97 

- 0.04 

1.14 

0.43 

0.00 

0.46 

0.98 

10243 

0.15 

24 

15 

0.49 

0.70 

- 1.57 

0.58 

- 1.42 

0.00 

0.65 

1.67 

10244 

0.56 

24 

13 

0.50 

1.01 

0.10 

0.84 

- 0.18 

- 0.01 

0.56 

1.04 

10245 

1.42 

24 

13 

0.51 

0.72 

- 1.45 

0.59 

- 1.09 

0.00 

0.69 

1.68 

10246 

- 0.56 

19 

15 

0.65 

0.78 

- 0.71 

0.53 

- 0.13 

- 0.01 

0.54 

1.38 

10247 

0.60 

22 

12 

0.51 

0.96 

- 0.12 

0.80 

- 0.41 

0.00 

0.56 

1.16 

10248 

0.51 

23 

16 

0.54 

1.52 

1.91 

1.55 

1.13 

- 0.01 

0.26 

0.11 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10249 

- 0.64 

23 

19 

0.63 

1.22 

0.68 

1.00 

0.27 

- 0.01 

0.34 

0.82 

10250 

0.08 

24 

17 

0.56 

0.81 

- 0.65 

1.05 

0.27 

0.00 

0.60 

1.17 

10251 

0.10 

23 

15 

0.50 

0.83 

- 0.76 

0.68 

- 0.83 

0.00 

0.61 

1.37 

10252 

- 0.28 

24 

18 

0.53 

0.93 

- 0.23 

0.81 

- 0.13 

- 0.01 

0.43 

1.14 

10253 

- 1.16 

24 

20 

0.60 

0.75 

- 0.71 

0.49 

- 0.55 

- 0.01 

0.50 

1.31 

10254 

- 0.59 

25 

19 

0.58 

0.82 

- 0.54 

0.63 

- 0.49 

0.00 

0.61 

1.25 

10255 

- 0.56 

22 

18 

0.64 

1.06 

0.28 

1.40 

0.72 

0.00 

0.40 

0.85 

10256 

- 1.39 

23 

19 

0.61 

1.31 

0.93 

1.26 

0.56 

0.00 

0.24 

0.67 

10257 

- 0.29 

22 

17 

0.60 

0.65 

- 1.29 

0.40 

- 0.78 

- 0.01 

0.65 

1.51 

10258 

- 2.98 

22 

21 

1.07 

0.94 

0.20 

0.32 

- 0.20 

- 0.01 

0.30 

1.09 

10259 

- 0.45 

23 

18 

0.55 

0.61 

- 1.60 

0.42 

- 1.00 

- 0.01 

0.62 

1.59 

10260 

- 0.26 

24 

19 

0.58 

0.75 

- 0.79 

0.47 

- 0.77 

0.00 

0.61 

1.35 

10261 

0.14 

24 

16 

0.49 

1.12 

0.66 

0.96 

0.05 

- 0.01 

0.40 

0.82 

10262 

- 1.33 

22 

19 

0.69 

0.66 

- 0.73 

0.36 

- 0.73 

0.00 

0.58 

1.32 

10263 

- 1.82 

23 

21 

0.78 

0.78 

- 0.27 

0.34 

- 0.33 

0.00 

0.40 

1.22 

10264 

- 0.74 

24 

20 

0.63 

0.58 

- 1.30 

0.31 

- 0.62 

- 0.01 

0.62 

1.46 

10265 

0.88 

27 

13 

0.46 

0.75 

- 1.33 

0.79 

- 0.61 

0.00 

0.64 

1.48 

10266 

0.99 

24 

15 

0.48 

0.71 

- 1.35 

0.61 

- 1.32 

0.00 

0.70 

1.55 

10267 

- 0.20 

24 

19 

0.60 

0.79 

- 0.60 

0.45 

- 0.73 

- 0.01 

0.63 

1.30 

10268 

0.59 

24 

15 

0.53 

0.80 

- 0.85 

0.69 

- 0.62 

- 0.01 

0.65 

1.39 

10269 

- 0.37 

25 

19 

0.55 

0.64 

- 1.61 

0.44 

- 1.01 

- 0.01 

0.62 

1.60 

10270 

- 0.04 

23 

15 

0.50 

0.75 

- 1.25 

0.60 

- 1.04 

- 0.01 

0.62 

1.57 

10271 

- 0.73 

24 

18 

0.53 

0.97 

- 0.06 

0.70 

- 0.26 

- 0.01 

0.45 

1.15 

10272 

- 1.74 

24 

21 

0.75 

0.76 

- 0.36 

0.32 

- 0.37 

0.00 

0.60 

1.23 

10273 

- 0.69 

191 

172 

0.25 

0.90 

- 0.49 

0.59 

- 1.16 

0.00 

0.37 

1.10 

10274 

0.00 

23 

23 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10275 

0.00 

24 

24 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10276 

- 0.50 

23 

19 

0.63 

0.68 

- 0.91 

0.40 

- 0.75 

0.00 

0.60 

1.38 

10277 

- 0.44 

24 

18 

0.53 

0.91 

- 0.26 

0.88 

- 0.17 

0.00 

0.46 

1.12 

10278 

0.27 

22 

14 

0.53 

0.95 

- 0.11 

0.91 

- 0.04 

0.00 

0.56 

1.07 

10279 

0.95 

24 

13 

0.49 

1.20 

0.98 

1.10 

0.40 

0.00 

0.45 

0.62 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10280 

- 0.18 

22 

18 

0.62 

0.60 

- 1.23 

0.35 

- 0.74 

- 0.01 

0.67 

1.44 

10281 

2.20 

23 

10 

0.48 

0.94 

- 0.28 

0.79 

- 0.27 

0.00 

0.52 

1.22 

10282 

- 0.55 

23 

17 

0.54 

1.13 

0.54 

1.67 

1.25 

0.00 

0.31 

0.71 

10283 

- 1.62 

23 

21 

0.83 

0.75 

- 0.25 

0.46 

- 0.06 

0.00 

0.51 

1.15 

10284 

0.71 

23 

14 

0.54 

0.79 

- 0.74 

0.63 

- 0.84 

0.00 

0.68 

1.35 

10285 

0.21 

23 

15 

0.49 

1.19 

0.94 

1.15 

0.49 

0.00 

0.34 

0.62 

10286 

0.70 

24 

14 

0.49 

0.75 

- 1.22 

0.70 

- 0.85 

0.00 

0.65 

1.52 

10287 

0.95 

24 

14 

0.48 

0.94 

- 0.30 

0.82 

- 0.43 

0.00 

0.54 

1.21 

10288 

1.77 

22 

9 

0.47 

0.98 

- 0.04 

0.90 

- 0.30 

0.00 

0.43 

1.11 

10289 

0.97 

24 

12 

0.49 

0.81 

- 0.91 

0.66 

- 0.95 

0.00 

0.64 

1.44 

10290 

1.14 

23 

9 

0.47 

1.02 

0.18 

1.04 

0.26 

0.00 

0.40 

0.92 

10291 

0.87 

24 

12 

0.53 

0.93 

- 0.18 

0.75 

- 0.54 

0.00 

0.66 

1.16 

10292 

- 0.49 

24 

19 

0.56 

1.32 

1.07 

1.58 

1.09 

0.00 

0.22 

0.57 

10293 

0.00 

23 

23 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10294 

0.00 

24 

24 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10295 

- 1.35 

23 

21 

0.77 

1.04 

0.25 

0.62 

- 0.08 

- 0.01 

0.29 

1.03 

10296 

0.00 

24 

24 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10297 

- 1.54 

23 

19 

0.79 

1.44 

0.92 

1.00 

0.42 

0.00 

0.59 

0.76 

10298 

- 0.11 

24 

18 

0.56 

1.19 

0.80 

0.93 

0.20 

- 0.01 

0.45 

0.75 

10299 

- 2.96 

24 

22 

0.82 

0.62 

- 0.62 

0.23 

- 0.36 

- 0.01 

0.52 

1.29 

10300 

- 1.64 

24 

21 

0.80 

0.59 

- 0.64 

0.23 

- 0.44 

0.00 

0.74 

1.29 

10301 

- 2.74 

23 

21 

1.06 

1.11 

0.41 

0.74 

0.27 

- 0.01 

0.53 

0.92 

10302 

- 0.72 

23 

19 

0.60 

0.85 

- 0.37 

0.54 

- 0.41 

0.00 

0.48 

1.23 

10303 

- 0.27 

24 

15 

0.51 

1.00 

0.06 

1.00 

0.15 

0.00 

0.53 

0.99 

10304 

- 1.89 

23 

21 

0.82 

1.42 

0.85 

1.07 

0.46 

0.00 

0.18 

0.77 

10305 

- 0.65 

22 

16 

0.64 

0.44 

- 2.02 

0.27 

- 0.81 

0.00 

0.77 

1.64 

10306 

- 2.37 

23 

22 

1.04 

0.85 

0.11 

0.30 

- 0.22 

0.00 

0.29 

1.13 

10307 

- 1.36 

23 

19 

0.63 

0.75 

- 0.64 

0.50 

- 0.38 

0.00 

0.58 

1.27 

10308 

- 1.50 

24 

21 

0.65 

0.88 

- 0.15 

0.60 

- 0.01 

- 0.01 

0.36 

1.12 

10309 

- 1.44 

23 

19 

0.68 

0.72 

- 0.65 

0.44 

- 0.41 

- 0.01 

0.59 

1.32 

10310 

- 1.30 

24 

21 

0.72 

0.99 

0.12 

1.26 

0.59 

0.00 

0.39 

0.94 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10311 

- 1.68 

23 

21 

0.79 

1.33 

0.75 

9.90 

2.92 

- 0.01 

- 0.02 

0.26 

10312 

- 1.71 

23 

20 

0.77 

0.51 

- 1.05 

0.20 

- 0.44 

- 0.01 

0.72 

1.37 

10313 

0.49 

171 

127 

0.19 

1.03 

0.33 

1.13 

0.77 

0.00 

0.35 

0.93 

10314 

1.34 

24 

12 

0.50 

1.23 

1.06 

1.44 

1.43 

0.00 

0.45 

0.41 

10315 

0.63 

23 

15 

0.58 

1.31 

1.12 

1.10 

0.35 

0.00 

0.56 

0.61 

10316 

0.64 

24 

14 

0.50 

0.90 

- 0.34 

0.90 

- 0.20 

0.00 

0.61 

1.17 

10317 

0.92 

23 

12 

0.51 

0.92 

- 0.28 

0.82 

- 0.49 

0.00 

0.62 

1.20 

10318 

0.16 

23 

17 

0.55 

0.83 

- 0.62 

0.62 

- 0.48 

- 0.01 

0.59 

1.29 

10319 

2.00 

24 

10 

0.50 

1.00 

0.09 

0.84 

- 0.26 

0.00 

0.57 

1.05 

10320 

- 0.06 

177 

141 

0.20 

0.90 

- 0.92 

0.98 

- 0.02 

0.00 

0.40 

1.10 

10321 

0.47 

23 

15 

0.53 

0.56 

- 1.99 

0.40 

- 1.58 

0.00 

0.80 

1.67 

10322 

- 0.55 

23 

16 

0.53 

0.93 

- 0.29 

0.71 

- 0.44 

- 0.01 

0.52 

1.23 

10323 

- 0.33 

192 

155 

0.20 

0.99 

- 0.05 

1.06 

0.33 

0.00 

0.34 

1.00 

10324 

- 0.03 

23 

17 

0.52 

0.95 

- 0.14 

0.81 

- 0.25 

0.00 

0.42 

1.12 

10325 

1.08 

23 

12 

0.50 

0.82 

- 0.89 

0.71 

- 0.76 

0.00 

0.64 

1.46 

10326 

- 0.28 

23 

15 

0.51 

1.02 

0.16 

0.89 

- 0.05 

- 0.01 

0.51 

1.00 

10327 

- 0.03 

23 

17 

0.55 

1.64 

2.10 

2.83 

2.18 

- 0.01 

0.06 

- 0.06 

10328 

0.13 

22 

15 

0.53 

1.05 

0.29 

0.90 

- 0.13 

0.00 

0.48 

0.97 

10329 

0.16 

24 

16 

0.50 

0.70 

- 1.29 

0.69 

- 0.72 

0.00 

0.67 

1.45 

10330 

- 0.13 

24 

16 

0.51 

0.52 

- 2.29 

0.40 

- 1.42 

0.00 

0.77 

1.76 

10331 

- 1.51 

25 

22 

0.66 

0.98 

0.08 

0.71 

- 0.02 

- 0.01 

0.33 

1.04 

10332 

0.34 

23 

15 

0.54 

1.04 

0.24 

0.79 

- 0.28 

0.00 

0.57 

1.03 

10333 

0.00 

22 

17 

0.57 

0.91 

- 0.23 

0.77 

- 0.31 

0.00 

0.45 

1.16 

10334 

- 1.74 

24 

22 

0.77 

1.18 

0.50 

1.15 

0.55 

0.00 

0.15 

0.85 

10335 

- 2.13 

179 

172 

0.40 

0.97 

0.03 

0.48 

- 0.82 

0.00 

0.28 

1.05 

10336 

- 1.20 

23 

20 

0.66 

1.15 

0.48 

0.83 

0.11 

- 0.01 

0.26 

0.93 

10337 

- 0.63 

21 

15 

0.56 

1.09 

0.42 

1.01 

0.19 

0.00 

0.43 

0.86 

10338 

- 1.64 

21 

20 

1.04 

0.96 

0.24 

0.45 

- 0.02 

0.00 

0.27 

1.07 

10339 

- 1.58 

23 

20 

0.69 

0.89 

- 0.15 

0.44 

- 0.03 

- 0.01 

0.46 

1.17 

10340 

- 2.35 

22 

21 

1.06 

0.92 

0.18 

0.30 

- 0.24 

- 0.01 

0.36 

1.10 

10341 

0.26 

22 

16 

0.55 

0.90 

- 0.29 

0.68 

- 0.37 

- 0.01 

0.56 

1.19 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10342 

- 1.10 

23 

19 

0.62 

0.94 

- 0.05 

0.56 

- 0.17 

0.00 

0.48 

1.14 

10343 

- 1.90 

24 

21 

0.73 

0.76 

- 0.34 

0.38 

- 0.39 

0.00 

0.61 

1.21 

10344 

- 1.07 

23 

18 

0.57 

0.72 

- 0.93 

0.50 

- 0.92 

0.00 

0.58 

1.38 

10345 

- 0.85 

24 

21 

0.68 

1.09 

0.35 

0.68 

- 0.01 

0.00 

0.35 

0.99 

10346 

- 1.85 

24 

22 

0.78 

1.11 

0.37 

0.91 

0.40 

- 0.01 

0.24 

0.92 

10347 

- 0.91 

24 

20 

0.63 

0.81 

- 0.50 

0.60 

- 0.07 

- 0.01 

0.51 

1.21 

10348 

- 1.76 

193 

180 

0.30 

0.89 

- 0.42 

0.47 

- 1.33 

0.00 

0.36 

1.11 

10349 

- 1.41 

21 

17 

0.61 

1.09 

0.43 

0.72 

0.12 

- 0.01 

0.36 

0.93 

10350 

- 1.98 

22 

20 

0.78 

0.83 

- 0.15 

0.37 

- 0.19 

- 0.01 

0.40 

1.18 

10351 

- 2.10 

24 

22 

0.76 

0.99 

0.17 

0.67 

0.08 

0.00 

0.24 

1.04 

10352 

- 2.11 

24 

22 

0.78 

0.78 

- 0.25 

0.34 

- 0.25 

0.00 

0.38 

1.21 

10353 

- 1.76 

23 

21 

0.81 

1.20 

0.53 

1.08 

0.52 

- 0.01 

0.24 

0.85 

10354 

- 0.42 

23 

16 

0.54 

0.73 

- 1.05 

0.51 

- 0.62 

- 0.01 

0.65 

1.45 

10355 

- 0.48 

24 

20 

0.61 

1.39 

1.13 

2.36 

1.36 

- 0.01 

0.12 

0.40 

10356 

- 1.21 

24 

20 

0.62 

1.09 

0.37 

0.87 

0.03 

0.00 

0.41 

0.95 

10357 

- 0.05 

24 

20 

0.60 

0.61 

- 1.24 

0.37 

- 1.05 

- 0.01 

0.62 

1.45 

10358 

0.44 

24 

15 

0.49 

0.54 

- 2.56 

0.45 

- 1.67 

0.00 

0.75 

1.96 

10359 

0.01 

24 

18 

0.55 

0.57 

- 1.54 

0.50 

- 1.16 

0.00 

0.72 

1.50 

10360 

1.07 

22 

12 

0.52 

1.05 

0.27 

0.92 

- 0.10 

0.00 

0.55 

0.97 

10361 

- 0.43 

23 

17 

0.55 

1.00 

0.06 

0.73 

- 0.12 

- 0.01 

0.48 

1.09 

10362 

- 0.17 

24 

19 

0.60 

0.78 

- 0.62 

0.46 

- 0.73 

- 0.01 

0.64 

1.30 

10363 

- 1.12 

24 

20 

0.67 

1.03 

0.20 

0.98 

0.29 

- 0.01 

0.51 

0.97 

10364 

- 0.27 

22 

16 

0.55 

0.86 

- 0.52 

0.70 

- 0.32 

- 0.01 

0.53 

1.27 

10365 

- 0.26 

26 

19 

0.52 

0.86 

- 0.51 

0.63 

- 0.56 

0.00 

0.57 

1.26 

10366 

- 0.74 

23 

18 

0.62 

1.09 

0.37 

2.00 

1.28 

0.00 

0.46 

0.76 

10367 

- 0.26 

21 

14 

0.51 

0.77 

- 1.12 

0.67 

- 0.60 

0.00 

0.57 

1.54 

10368 

2.41 

25 

6 

0.54 

0.87 

- 0.38 

0.65 

- 0.60 

0.00 

0.60 

1.21 

10369 

- 1.06 

24 

21 

0.66 

1.21 

0.62 

1.70 

0.98 

0.00 

0.16 

0.72 

10370 

1.09 

23 

11 

0.49 

0.73 

- 1.30 

0.63 

- 1.10 

- 0.01 

0.69 

1.55 

10371 

1.85 

24 

8 

0.53 

1.06 

0.31 

1.33 

0.81 

0.00 

0.51 

0.86 

10372 

- 0.48 

20 

14 

0.61 

1.36 

1.20 

1.32 

0.63 

0.00 

0.43 

0.47 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10373 

- 1.35 

24 

20 

0.66 

0.57 

- 1.10 

0.30 

- 0.57 

0.00 

0.69 

1.39 

10374 

- 0.01 

23 

18 

0.56 

0.96 

- 0.03 

0.85 

- 0.03 

0.00 

0.42 

1.06 

10375 

- 1.12 

24 

19 

0.62 

1.01 

0.15 

1.16 

0.45 

0.00 

0.51 

0.91 

10376 

- 0.52 

24 

18 

0.54 

0.68 

- 1.41 

0.46 

- 0.77 

- 0.01 

0.62 

1.54 

10377 

- 0.74 

24 

19 

0.58 

0.93 

- 0.11 

0.76 

- 0.12 

- 0.01 

0.50 

1.09 

10378 

- 1.04 

179 

160 

0.26 

0.79 

- 1.21 

0.54 

- 1.36 

0.00 

0.46 

1.17 

10379 

- 0.81 

24 

18 

0.58 

0.38 

- 2.39 

0.24 

- 1.54 

0.00 

0.85 

1.64 

10380 

- 0.67 

23 

19 

0.62 

1.48 

1.30 

1.23 

0.54 

0.00 

0.20 

0.55 

10381 

0.48 

22 

14 

0.54 

0.95 

- 0.13 

0.95 

0.03 

0.00 

0.56 

1.06 

10382 

0.45 

24 

14 

0.49 

0.58 

- 2.45 

0.50 

- 1.98 

0.00 

0.73 

2.00 

10383 

0.85 

24 

12 

0.47 

1.08 

0.50 

0.99 

0.07 

0.00 

0.44 

0.84 

10384 

0.65 

23 

15 

0.50 

0.70 

- 1.56 

0.60 

- 1.22 

0.00 

0.63 

1.71 

10385 

0.83 

21 

13 

0.51 

0.65 

- 1.81 

0.52 

- 1.36 

0.00 

0.72 

1.76 

10386 

1.13 

24 

12 

0.48 

1.03 

0.22 

0.90 

- 0.17 

0.00 

0.52 

0.99 

10387 

- 0.33 

24 

18 

0.51 

0.86 

- 0.57 

0.65 

- 0.73 

- 0.01 

0.51 

1.30 

10388 

- 0.93 

21 

17 

0.61 

1.10 

0.41 

1.09 

0.36 

0.00 

0.29 

0.87 

10389 

0.26 

22 

14 

0.52 

0.78 

- 0.92 

0.64 

- 0.84 

0.00 

0.65 

1.43 

10390 

- 0.01 

24 

16 

0.51 

0.90 

- 0.36 

0.75 

- 0.39 

0.00 

0.54 

1.22 

10391 

0.74 

24 

16 

0.49 

1.29 

1.27 

1.24 

0.70 

- 0.01 

0.27 

0.50 

10392 

- 0.25 

24 

17 

0.49 

1.01 

0.11 

1.03 

0.21 

- 0.01 

0.35 

0.95 

10393 

1.27 

23 

11 

0.52 

1.13 

0.65 

1.13 

0.49 

0.00 

0.52 

0.70 

10394 

- 1.13 

24 

21 

0.70 

0.58 

- 1.06 

0.26 

- 0.60 

- 0.01 

0.62 

1.39 

10395 

- 1.54 

24 

20 

0.64 

0.71 

- 0.72 

0.36 

- 0.20 

0.00 

0.59 

1.32 

10396 

- 1.16 

24 

21 

0.72 

0.68 

- 0.59 

0.32 

- 0.42 

0.00 

0.58 

1.28 

10397 

0.02 

25 

19 

0.52 

0.84 

- 0.53 

0.86 

- 0.18 

0.00 

0.55 

1.19 

10398 

- 0.16 

21 

15 

0.58 

1.09 

0.42 

2.30 

1.95 

0.00 

0.45 

0.60 

10399 

- 0.47 

24 

19 

0.59 

0.74 

- 0.80 

0.47 

- 0.53 

0.00 

0.59 

1.36 

10400 

- 1.25 

24 

21 

0.65 

1.06 

0.28 

1.66 

0.87 

0.00 

0.17 

0.85 

10401 

- 2.65 

24 

23 

1.05 

1.18 

0.48 

5.78 

2.17 

0.00 

- 0.11 

0.64 

10402 

- 0.77 

24 

20 

0.59 

1.23 

0.75 

1.69 

1.16 

0.00 

0.13 

0.65 

10403 

- 0.68 

24 

19 

0.57 

0.86 

- 0.39 

0.67 

- 0.29 

- 0.01 

0.54 

1.18 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10404 

0.64 

23 

15 

0.52 

1.29 

1.22 

1.25 

0.67 

0.00 

0.37 

0.46 

10405 

4.68 

24 

2 

0.84 

1.71 

1.26 

2.77 

1.33 

0.00 

- 0.05 

0.38 

10406 

2.16 

24 

7 

0.52 

2.32 

3.95 

4.57 

4.10 

0.00 

- 0.48 

- 1.42 

10407 

0.00 

23 

23 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

10408 

- 2.47 

24 

23 

1.07 

1.22 

0.52 

1.12 

0.55 

- 0.01 

0.14 

0.82 

10409 

- 1.72 

24 

22 

0.78 

0.70 

- 0.46 

0.28 

- 0.26 

- 0.01 

0.44 

1.26 

10410 

1.53 

20 

8 

0.62 

0.95 

- 0.05 

0.73 

- 0.22 

0.00 

0.69 

1.12 

10411 

2.24 

23 

11 

0.49 

0.71 

- 1.60 

0.72 

- 0.98 

0.00 

0.68 

1.71 

10412 

0.18 

23 

16 

0.51 

1.41 

1.65 

1.89 

1.60 

0.00 

0.15 

0.17 

10413 

0.44 

24 

16 

0.51 

1.03 

0.19 

0.95 

0.03 

0.00 

0.49 

0.96 

10414 

- 0.69 

24 

19 

0.57 

1.25 

0.93 

1.11 

0.39 

0.00 

0.30 

0.67 

10415 

0.28 

23 

14 

0.52 

0.98 

- 0.01 

0.79 

- 0.17 

- 0.01 

0.56 

1.09 

10416 

- 1.26 

22 

19 

0.67 

1.21 

0.63 

1.31 

0.62 

- 0.01 

0.22 

0.76 

10417 

0.16 

23 

16 

0.54 

1.00 

0.11 

2.46 

2.02 

- 0.01 

0.45 

0.80 

10418 

- 2.48 

23 

22 

1.05 

0.77 

0.00 

0.21 

- 0.39 

0.00 

0.36 

1.17 

10419 

- 2.04 

25 

23 

0.78 

1.11 

0.38 

3.52 

1.64 

- 0.01 

0.08 

0.76 

10420 

1.94 

24 

9 

0.57 

1.19 

0.65 

1.25 

0.62 

0.00 

0.59 

0.79 

10421 

- 1.77 

23 

21 

0.80 

0.74 

- 0.32 

0.42 

- 0.22 

0.00 

0.40 

1.20 

10422 

- 1.72 

23 

21 

0.76 

1.14 

0.42 

1.20 

0.55 

0.00 

0.06 

0.88 

10423 

- 0.29 

22 

17 

0.58 

0.75 

- 0.87 

0.55 

- 0.58 

- 0.01 

0.57 

1.39 

10424 

- 0.35 

24 

18 

0.54 

0.77 

- 0.82 

0.54 

- 0.69 

0.00 

0.58 

1.37 

10425 

- 0.47 

24 

18 

0.54 

0.91 

- 0.24 

0.79 

- 0.10 

0.00 

0.48 

1.14 

10426 

0.81 

22 

13 

0.52 

0.92 

- 0.30 

0.76 

- 0.29 

0.00 

0.58 

1.19 

10427 

0.65 

22 

9 

0.47 

0.99 

0.02 

0.98 

- 0.01 

0.00 

0.41 

1.03 

10428 

0.47 

24 

13 

0.45 

1.30 

1.64 

1.31 

1.28 

0.00 

0.17 

0.19 

10429 

- 1.66 

23 

21 

0.81 

1.29 

0.65 

5.00 

2.22 

- 0.01 

0.04 

0.63 

10430 

- 2.40 

23 

22 

1.06 

1.07 

0.37 

0.61 

0.15 

- 0.01 

0.22 

0.99 

10431 

- 2.52 

22 

20 

1.05 

1.12 

0.42 

1.04 

0.50 

0.00 

0.54 

0.92 

10432 

- 0.33 

171 

144 

0.23 

1.10 

0.76 

1.21 

0.80 

0.00 

0.26 

0.89 

10433 

1.37 

23 

12 

0.56 

1.36 

1.24 

1.79 

1.45 

0.00 

0.50 

0.36 

10434 

0.36 

22 

14 

0.51 

0.96 

- 0.10 

1.13 

0.51 

0.00 

0.45 

0.99 
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Appendix D: Item Statistics 


ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10435 

2.34 

24 

10 

0.49 

1.22 

0.98 

1.28 

0.95 

0.00 

0.39 

0.57 

10436 

0.91 

24 

14 

0.50 

0.91 

- 0.33 

0.90 

- 0.13 

0.00 

0.60 

1.16 

10437 

- 1.51 

22 

18 

0.64 

0.88 

- 0.24 

0.51 

0.01 

- 0.01 

0.51 

1.20 

10438 

- 1.83 

24 

22 

0.77 

0.70 

- 0.43 

0.27 

- 0.46 

- 0.01 

0.50 

1.25 

10439 

- 0.26 

25 

18 

0.49 

1.00 

0.07 

0.91 

- 0.10 

0.00 

0.38 

1.03 

10440 

- 0.25 

22 

15 

0.53 

1.08 

0.45 

0.80 

- 0.14 

0.00 

0.46 

0.95 

10441 

- 0.90 

23 

18 

0.71 

1.45 

1.03 

1.84 

0.98 

0.00 

0.54 

0.57 

10442 

1.12 

22 

13 

0.54 

1.30 

1.29 

1.31 

0.81 

0.00 

0.46 

0.36 

10443 

1.60 

22 

10 

0.50 

1.01 

0.12 

0.94 

- 0.06 

0.00 

0.52 

1.01 

10444 

- 0.03 

22 

15 

0.50 

0.87 

- 0.57 

0.74 

- 0.67 

0.00 

0.51 

1.33 

10445 

- 1.02 

21 

18 

0.67 

1.06 

0.28 

2.64 

1.46 

0.00 

0.20 

0.70 

10446 

- 0.49 

23 

19 

0.63 

0.65 

- 0.94 

0.41 

- 0.98 

0.00 

0.62 

1.38 

10447 

1.19 

22 

13 

0.54 

0.79 

- 0.95 

0.64 

- 0.95 

0.00 

0.67 

1.51 

10448 

- 0.71 

23 

19 

0.66 

0.79 

- 0.45 

0.47 

- 0.28 

0.00 

0.58 

1.25 

10449 

0.36 

24 

16 

0.52 

1.23 

1.05 

1.17 

0.51 

0.00 

0.42 

0.61 

10450 

- 0.31 

24 

20 

0.59 

0.90 

- 0.21 

0.65 

- 0.36 

0.00 

0.44 

1.16 

30006 

1.71 

17 

7 

0.56 

1.40 

1.72 

1.81 

1.92 

0.00 

0.12 

- 0.10 

30011 

1.00 

21 

10 

0.49 

1.22 

1.26 

1.26 

1.24 

0.00 

0.24 

0.22 

30104 

1.85 

15 

6 

0.64 

1.65 

2.06 

1.67 

1.15 

0.00 

0.26 

- 0.29 

30105 

0.01 

25 

18 

0.52 

0.80 

- 0.73 

0.92 

- 0.03 

0.00 

0.56 

1.24 

30106 

- 2.31 

23 

21 

0.93 

0.30 

- 1.31 

0.10 

- 0.67 

- 0.01 

0.69 

1.40 

30108 

- 1.02 

24 

21 

0.71 

0.91 

- 0.01 

0.82 

0.12 

0.00 

0.48 

1.05 

30110 

- 1.65 

20 

18 

0.77 

0.88 

- 0.05 

0.50 

0.03 

- 0.01 

0.33 

1.14 

30111 

- 0.96 

22 

19 

0.67 

0.88 

- 0.19 

0.55 

- 0.34 

- 0.01 

0.45 

1.16 

30112 

- 1.02 

23 

20 

0.68 

0.74 

- 0.54 

0.54 

- 0.26 

- 0.01 

0.53 

1.21 

30114 

0.06 

166 

128 

0.20 

1.06 

0.62 

1.51 

2.13 

0.00 

0.31 

0.84 

30115 

0.00 

17 

17 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30116 

- 0.96 

19 

17 

0.78 

1.26 

0.62 

1.48 

0.75 

- 0.01 

0.06 

0.75 

30117 

- 0.52 

24 

18 

0.52 

1.22 

0.90 

0.98 

0.14 

- 0.01 

0.29 

0.74 

30118 

- 0.59 

21 

17 

0.61 

0.79 

- 0.70 

0.56 

- 0.40 

0.00 

0.47 

1.38 

30123 

0.09 

21 

15 

0.55 

1.69 

2.39 

1.67 

1.15 

- 0.01 

0.04 

- 0.10 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30124 

- 0.26 

19 

15 

0.65 

1.14 

0.50 

0.98 

0.22 

0.00 

0.41 

0.87 

30125 

- 1.89 

22 

19 

0.78 

1.08 

0.33 

0.80 

0.32 

- 0.01 

0.49 

0.96 

30126 

2.74 

23 

7 

0.61 

0.73 

- 0.78 

0.55 

- 0.27 

0.00 

0.72 

1.32 

30129 

1.43 

22 

10 

0.54 

1.22 

0.83 

1.49 

1.22 

0.00 

0.48 

0.59 

30134 

0.00 

22 

21 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30135 

- 2.88 

25 

24 

1.04 

1.09 

0.39 

1.06 

0.51 

- 0.01 

0.11 

0.93 

30148 

0.06 

15 

11 

0.71 

1.35 

1.00 

1.37 

0.67 

- 0.01 

0.37 

0.53 

30149 

1.67 

26 

13 

0.46 

0.85 

- 0.72 

0.74 

- 0.64 

0.00 

0.61 

1.35 

30251 

- 2.11 

21 

20 

1.07 

0.73 

- 0.08 

0.22 

- 0.37 

- 0.01 

0.38 

1.20 

30253 

0.00 

14 

14 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30256 

- 1.05 

30 

24 

0.52 

0.66 

- 1.26 

0.47 

- 0.89 

0.00 

0.61 

1.42 

30257 

0.21 

17 

12 

0.61 

1.07 

0.35 

1.04 

0.25 

0.00 

0.43 

0.87 

30258 

- 0.18 

22 

16 

0.56 

1.07 

0.34 

0.82 

- 0.11 

0.00 

0.48 

0.98 

30259 

- 1.01 

26 

21 

0.56 

0.81 

- 0.71 

0.49 

- 0.28 

- 0.01 

0.50 

1.34 

30261 

- 2.32 

22 

20 

0.84 

0.69 

- 0.43 

0.26 

- 0.30 

- 0.01 

0.57 

1.24 

30265 

- 2.17 

16 

15 

1.07 

1.04 

0.33 

0.59 

0.13 

0.00 

0.25 

1.02 

30266 

- 0.75 

23 

19 

0.61 

0.95 

- 0.07 

0.69 

- 0.06 

- 0.01 

0.40 

1.09 

30267 

0.00 

20 

20 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30268 

- 1.30 

15 

12 

0.71 

1.14 

0.51 

0.91 

0.26 

- 0.01 

0.31 

0.84 

30269 

- 1.00 

27 

23 

0.64 

1.32 

0.85 

1.08 

0.39 

0.00 

0.35 

0.76 

30271 

- 2.82 

25 

24 

1.05 

0.84 

0.09 

0.25 

- 0.32 

0.00 

0.31 

1.13 

30275 

2.00 

637 

239 

0.10 

1.06 

1.36 

1.17 

1.78 

0.00 

0.51 

0.86 

30308 

0.58 

636 

391 

0.10 

0.98 

- 0.41 

0.95 

- 0.58 

0.00 

0.53 

1.05 

30401 

- 0.43 

20 

15 

0.70 

1.04 

0.24 

1.50 

0.82 

0.00 

0.61 

0.88 

30402 

- 1.92 

23 

21 

0.77 

1.10 

0.35 

2.76 

1.32 

0.00 

0.08 

0.77 

30403 

- 2.29 

20 

19 

1.05 

0.94 

0.22 

0.40 

- 0.08 

- 0.01 

0.30 

1.08 

30404 

- 1.80 

33 

31 

0.76 

0.85 

- 0.09 

0.34 

- 0.28 

0.00 

0.35 

1.15 

30405 

0.61 

20 

12 

0.57 

1.16 

0.68 

1.27 

0.61 

- 0.01 

0.51 

0.68 

30406 

- 0.64 

32 

26 

0.52 

0.99 

0.07 

0.71 

- 0.27 

0.00 

0.47 

1.06 

30410 

- 0.36 

12 

9 

0.70 

0.96 

0.00 

1.15 

0.45 

0.00 

0.30 

0.98 

30413 

0.04 

24 

17 

0.52 

1.12 

0.58 

1.09 

0.35 

- 0.01 

0.44 

0.81 
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Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30416 

- 0.80 

35 

29 

0.48 

1.12 

0.54 

0.86 

- 0.06 

- 0.01 

0.29 

0.91 

30417 

1.02 

28 

16 

0.48 

1.00 

0.09 

1.02 

0.20 

0.00 

0.57 

0.96 

30419 

- 0.77 

25 

21 

0.63 

0.52 

- 1.48 

0.26 

- 1.04 

- 0.01 

0.70 

1.46 

30421 

- 0.95 

24 

20 

0.60 

0.81 

- 0.58 

0.52 

- 0.55 

- 0.01 

0.47 

1.29 

30422 

- 0.53 

25 

18 

0.52 

1.27 

1.18 

1.88 

1.39 

0.00 

0.30 

0.36 

30424 

0.17 

34 

23 

0.41 

1.03 

0.25 

1.08 

0.38 

0.00 

0.39 

0.92 

30457 

- 1.08 

27 

24 

0.65 

1.18 

0.55 

1.06 

0.34 

0.00 

0.19 

0.86 

30458 

- 1.18 

21 

17 

0.67 

1.56 

1.31 

1.62 

0.85 

0.00 

0.25 

0.44 

30459 

1.94 

25 

10 

0.49 

0.80 

- 0.91 

0.65 

- 0.82 

0.00 

0.65 

1.43 

30511 

- 0.74 

19 

15 

0.62 

1.02 

0.17 

0.96 

0.15 

- 0.01 

0.37 

0.97 

30512 

- 1.04 

17 

14 

0.68 

0.82 

- 0.36 

0.55 

- 0.54 

0.00 

0.53 

1.25 

30513 

- 0.06 

19 

13 

0.60 

1.48 

1.72 

1.33 

0.68 

- 0.01 

0.36 

0.19 

30514 

- 0.93 

21 

16 

0.62 

1.31 

1.00 

1.76 

0.97 

0.00 

0.37 

0.49 

30515 

- 0.15 

20 

14 

0.55 

1.19 

0.81 

1.16 

0.57 

0.00 

0.30 

0.63 

30517 

0.49 

18 

12 

0.58 

1.17 

0.69 

1.74 

1.67 

0.00 

0.31 

0.49 

30518 

- 1.71 

32 

28 

0.57 

0.97 

0.05 

0.89 

0.22 

0.00 

0.30 

1.01 

30519 

0.89 

15 

9 

0.65 

0.86 

- 0.39 

0.69 

- 0.43 

0.00 

0.65 

1.30 

30520 

- 0.50 

21 

15 

0.54 

1.43 

1.69 

1.42 

0.90 

- 0.01 

0.13 

0.27 

30555 

0.40 

18 

12 

0.58 

1.40 

1.45 

1.51 

1.45 

0.00 

0.25 

0.14 

30557 

- 0.59 

23 

19 

0.60 

0.85 

- 0.38 

0.81 

0.00 

- 0.01 

0.43 

1.14 

30559 

- 1.88 

15 

14 

1.07 

1.24 

0.54 

3.04 

1.42 

- 0.01 

- 0.08 

0.67 

30560 

- 1.39 

20 

16 

0.67 

1.03 

0.21 

0.64 

- 0.11 

- 0.01 

0.51 

1.05 

30561 

0.71 

23 

13 

0.47 

0.66 

- 2.01 

0.57 

- 1.57 

0.00 

0.71 

1.86 

30564 

0.68 

14 

9 

0.63 

1.28 

1.02 

1.30 

0.75 

0.00 

0.23 

0.42 

30579 

- 0.01 

23 

17 

0.55 

1.37 

1.31 

1.10 

0.37 

- 0.01 

0.33 

0.57 

30583 

- 0.94 

19 

16 

0.67 

0.93 

- 0.08 

0.58 

- 0.18 

- 0.01 

0.38 

1.16 

30589 

- 0.94 

27 

21 

0.53 

1.20 

0.80 

1.50 

0.79 

- 0.01 

0.33 

0.60 

30590 

0.00 

13 

12 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30591 

- 0.95 

19 

17 

0.79 

0.95 

0.09 

0.52 

- 0.10 

0.00 

0.35 

1.11 

30594 

- 1.94 

169 

161 

0.38 

0.96 

- 0.03 

0.60 

- 0.50 

0.00 

0.28 

1.04 

30595 

- 1.59 

26 

23 

0.68 

1.14 

0.47 

0.83 

0.26 

- 0.01 

0.33 

0.91 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30598 

- 0.95 

23 

20 

0.69 

1.29 

0.82 

2.49 

1.27 

- 0.01 

0.15 

0.53 

30600 

- 0.16 

20 

15 

0.59 

0.88 

- 0.39 

0.98 

0.19 

- 0.01 

0.47 

1.14 

30601 

- 0.40 

29 

22 

0.51 

0.68 

- 1.31 

0.93 

0.11 

- 0.01 

0.61 

1.32 

30602 

0.63 

22 

13 

0.48 

0.80 

- 1.09 

0.81 

- 0.55 

0.00 

0.59 

1.47 

30605 

1.75 

26 

12 

0.49 

0.99 

0.01 

0.93 

- 0.10 

0.00 

0.59 

1.04 

30606 

0.82 

16 

10 

0.60 

0.90 

- 0.31 

0.80 

- 0.22 

0.00 

0.55 

1.21 

30608 

0.99 

20 

11 

0.52 

0.91 

- 0.33 

0.81 

- 0.44 

0.00 

0.56 

1.23 

30609 

0.81 

22 

12 

0.53 

0.85 

- 0.60 

0.72 

- 0.62 

0.00 

0.64 

1.31 

30613 

- 0.16 

22 

18 

0.61 

0.96 

- 0.02 

2.41 

1.69 

- 0.01 

0.32 

0.84 

30618 

1.37 

19 

9 

0.53 

0.80 

- 0.88 

0.81 

- 0.41 

0.00 

0.60 

1.42 

30619 

1.21 

23 

13 

0.54 

0.98 

0.03 

0.86 

- 0.19 

0.00 

0.62 

1.06 

30701 

- 1.54 

21 

18 

0.66 

0.80 

- 0.41 

0.44 

- 0.61 

0.00 

0.52 

1.25 

30702 

0.00 

19 

19 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30703 

- 1.88 

15 

14 

1.10 

1.35 

0.67 

1.88 

0.97 

- 0.01 

0.03 

0.64 

30705 

- 2.61 

16 

15 

1.07 

0.92 

0.17 

0.42 

- 0.06 

0.00 

0.30 

1.10 

30706 

- 2.21 

14 

13 

1.25 

0.35 

- 0.81 

0.10 

- 0.68 

- 0.01 

0.62 

1.40 

30707 

0.04 

23 

17 

0.60 

0.92 

- 0.20 

0.62 

- 0.33 

0.00 

0.62 

1.19 

30708 

- 1.27 

23 

20 

0.67 

1.21 

0.63 

1.11 

0.41 

0.00 

0.23 

0.79 

30709 

- 0.98 

18 

15 

0.69 

1.08 

0.33 

1.02 

0.39 

- 0.01 

0.31 

0.88 

30710 

- 0.27 

31 

21 

0.45 

1.37 

1.58 

1.54 

1.41 

0.00 

0.29 

0.38 

30711 

- 2.01 

17 

16 

1.08 

0.84 

0.05 

0.31 

- 0.22 

- 0.01 

0.37 

1.16 

30715 

- 1.22 

30 

25 

0.55 

1.06 

0.28 

0.69 

- 0.13 

0.00 

0.40 

1.02 

30716 

- 2.73 

22 

21 

1.05 

1.14 

0.44 

1.84 

0.95 

0.00 

- 0.01 

0.84 

30717 

0.00 

12 

12 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30718 

- 0.66 

20 

17 

0.68 

0.82 

- 0.36 

0.64 

- 0.21 

- 0.01 

0.47 

1.19 

30724 

- 0.23 

18 

13 

0.66 

0.71 

- 0.81 

0.51 

- 0.75 

0.00 

0.67 

1.40 

30725 

0.05 

22 

17 

0.63 

1.01 

0.13 

1.13 

0.40 

0.00 

0.55 

0.93 

30735 

1.82 

18 

5 

0.58 

0.75 

- 0.89 

0.57 

- 0.87 

0.00 

0.63 

1.45 

30736 

1.56 

19 

7 

0.57 

1.05 

0.26 

0.91 

- 0.04 

0.00 

0.53 

0.97 

30738 

0.41 

20 

13 

0.56 

0.80 

- 0.72 

0.63 

- 0.88 

0.00 

0.64 

1.39 

30741 

0.00 

24 

24 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 
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Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

30742 

- 0.60 

17 

13 

0.70 

1.54 

1.36 

3.50 

1.91 

0.00 

0.23 

0.18 

30743 

0.05 

19 

12 

0.57 

1.20 

0.88 

0.95 

0.16 

- 0.01 

0.45 

0.70 

30745 

0.08 

14 

11 

0.74 

1.05 

0.25 

1.28 

0.59 

0.00 

0.40 

0.89 

30746 

- 1.71 

28 

26 

0.78 

0.76 

- 0.29 

0.31 

- 0.41 

- 0.01 

0.42 

1.21 

30747 

2.54 

18 

6 

0.60 

1.18 

0.71 

1.23 

0.54 

0.00 

0.42 

0.64 

30754 

1.57 

22 

7 

0.51 

1.04 

0.25 

1.06 

0.29 

0.00 

0.38 

0.92 

30756 

0.18 

17 

11 

0.60 

1.36 

1.47 

1.46 

0.98 

0.00 

0.33 

0.08 

30757 

0.86 

16 

8 

0.57 

1.40 

1.73 

1.35 

1.14 

0.00 

0.25 

- 0.08 

30760 

- 0.49 

20 

15 

0.60 

1.03 

0.20 

0.71 

- 0.23 

- 0.01 

0.50 

1.04 

30761 

0.00 

18 

17 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30852 

0.47 

10 

7 

0.79 

0.56 

- 1.30 

0.41 

- 0.82 

- 0.01 

0.77 

1.71 

30856 

1.86 

27 

11 

0.48 

1.31 

1.34 

1.48 

1.12 

0.00 

0.42 

0.42 

30864 

0.13 

18 

12 

0.59 

1.00 

0.10 

0.83 

- 0.11 

0.00 

0.54 

1.04 

30871 

0.24 

19 

10 

0.55 

1.69 

2.45 

1.82 

1.78 

0.00 

0.13 

- 0.32 

30873 

0.00 

19 

19 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

30875 

- 3.06 

21 

20 

1.06 

1.09 

0.38 

0.69 

0.22 

0.00 

0.18 

0.97 

30884 

- 1.18 

9 

7 

1.08 

1.18 

0.48 

1.65 

0.89 

0.00 

0.58 

0.78 

30889 

- 1.54 

17 

15 

0.81 

1.31 

0.71 

1.03 

0.39 

- 0.01 

0.14 

0.80 

30890 

0.19 

27 

16 

0.44 

1.28 

1.59 

1.14 

0.47 

0.00 

0.28 

0.36 

30907 

0.07 

16 

12 

0.68 

0.66 

- 0.92 

0.49 

- 0.69 

0.00 

0.67 

1.45 

30912 

1.58 

27 

11 

0.50 

1.50 

1.94 

2.21 

1.90 

0.00 

0.38 

0.01 

30945 

2.13 

25 

9 

0.53 

1.05 

0.28 

1.92 

1.44 

0.00 

0.52 

0.75 

31001 

- 1.52 

29 

26 

0.66 

0.86 

- 0.20 

0.76 

- 0.01 

- 0.01 

0.43 

1.10 

31003 

- 1.17 

12 

9 

0.75 

0.92 

- 0.12 

0.84 

0.16 

- 0.01 

0.46 

1.09 

31012 

0.09 

30 

21 

0.46 

0.90 

- 0.38 

0.79 

- 0.47 

0.00 

0.53 

1.19 

31013 

- 2.65 

17 

16 

1.13 

0.45 

- 0.57 

0.11 

- 0.63 

0.00 

0.50 

1.32 

31014 

0.05 

24 

16 

0.49 

0.93 

- 0.30 

0.82 

- 0.29 

0.00 

0.50 

1.18 

31015 

- 2.17 

19 

18 

1.06 

0.76 

- 0.03 

0.26 

- 0.30 

0.00 

0.36 

1.18 

31016 

1.48 

23 

11 

0.48 

1.39 

1.82 

1.76 

2.25 

0.00 

0.15 

- 0.05 

31018 

- 0.46 

17 

12 

0.60 

1.09 

0.43 

0.95 

0.10 

- 0.01 

0.39 

0.87 

31019 

- 0.41 

20 

15 

0.60 

1.10 

0.43 

0.83 

0.02 

0.00 

0.43 

0.92 
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Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

31020 

1.80 

25 

12 

0.51 

0.98 

0.00 

1.07 

0.30 

0.00 

0.62 

1.00 

31021 

- 0.84 

14 

12 

0.85 

0.60 

- 0.78 

0.35 

- 0.69 

- 0.01 

0.55 

1.42 

31022 

- 0.82 

22 

18 

0.61 

1.20 

0.70 

4.80 

2.90 

- 0.01 

0.13 

0.44 

31025 

1.34 

26 

11 

0.49 

1.23 

1.02 

1.92 

2.08 

0.00 

0.42 

0.40 

31156 

- 0.07 

15 

11 

0.70 

1.06 

0.30 

1.29 

0.59 

- 0.01 

0.46 

0.79 

31159 

0.92 

29 

15 

0.44 

1.05 

0.35 

1.05 

0.25 

0.00 

0.48 

0.85 

31160 

- 2.53 

21 

20 

1.07 

0.94 

0.20 

0.34 

- 0.17 

0.00 

0.30 

1.08 

31162 

- 2.09 

23 

21 

0.77 

1.17 

0.48 

0.98 

0.45 

- 0.01 

0.16 

0.87 

31163 

0.76 

340 

238 

0.13 

1.13 

2.16 

1.24 

2.01 

0.00 

0.32 

0.73 

31180 

- 0.45 

28 

23 

0.54 

1.12 

0.46 

1.28 

0.62 

- 0.01 

0.28 

0.83 

31181 

0.00 

15 

15 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

31182 

- 0.21 

21 

14 

0.53 

1.04 

0.24 

0.82 

- 0.09 

0.00 

0.47 

1.00 

31186 

- 2.42 

18 

16 

1.10 

1.39 

0.71 

9.61 

2.87 

- 0.01 

0.38 

0.25 

31193 

- 1.54 

22 

19 

0.71 

0.87 

- 0.14 

3.54 

1.84 

0.00 

0.31 

0.87 

31200 

- 2.35 

28 

26 

0.79 

0.91 

0.02 

1.46 

0.75 

0.00 

0.26 

0.97 

31201 

- 1.52 

19 

17 

0.78 

0.87 

- 0.09 

0.45 

- 0.11 

- 0.01 

0.40 

1.16 

31203 

- 0.85 

176 

151 

0.24 

1.00 

0.07 

0.91 

- 0.25 

0.00 

0.35 

1.00 

31205 

0.64 

29 

17 

0.47 

1.18 

0.81 

1.27 

0.79 

0.00 

0.50 

0.70 

31208 

1.72 

16 

6 

0.66 

1.21 

0.81 

1.43 

0.72 

0.00 

0.50 

0.45 

31209 

1.32 

16 

9 

0.64 

1.36 

1.12 

2.21 

1.76 

0.00 

0.41 

0.33 

31210 

0.21 

18 

12 

0.60 

1.03 

0.21 

0.89 

- 0.10 

0.00 

0.52 

1.00 

1G11 

- 2.21 

78 

75 

0.61 

0.94 

0.04 

0.53 

- 0.25 

0.00 

0.28 

1.05 

1G110 

- 1.05 

72 

65 

0.45 

0.98 

0.06 

1.04 

0.28 

0.00 

0.35 

0.99 

1G111 

- 0.20 

87 

70 

0.30 

0.99 

- 0.01 

0.73 

- 0.78 

0.00 

0.43 

1.07 

1G112 

- 3.16 

97 

96 

1.01 

1.03 

0.35 

1.09 

0.47 

0.00 

0.03 

0.97 

1G113 

- 1.30 

149 

138 

0.33 

0.86 

- 0.49 

0.73 

- 0.47 

0.00 

0.35 

1.09 

1G114 

0.19 

73 

61 

0.34 

0.94 

- 0.26 

0.95 

0.03 

0.00 

0.36 

1.04 

1G115 

- 0.94 

76 

66 

0.37 

0.81 

- 0.79 

0.58 

- 1.00 

0.00 

0.47 

1.18 

1G116 

- 2.26 

148 

143 

0.47 

1.10 

0.39 

0.89 

0.09 

0.00 

0.13 

0.95 

1G117 

- 0.12 

74 

56 

0.30 

1.12 

0.77 

1.06 

0.30 

0.00 

0.33 

0.85 

1G118 

- 0.15 

73 

62 

0.35 

1.13 

0.66 

1.89 

1.86 

0.00 

0.17 

0.80 
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Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1G119 

-0.19 

79 

66 

0.32 

0.92 

-0.39 

0.71 

-0.77 

0.00 

0.36 

1.13 

1G12 

-2.56 

73 

71 

0.74 

0.80 

-0.12 

0.25 

-0.62 

0.00 

0.35 

1.12 

1G120 

-1.34 

79 

74 

0.48 

0.86 

-0.25 

0.52 

-0.63 

0.00 

0.35 

1.10 

1G121 

-2.84 

86 

84 

0.73 

1.04 

0.28 

0.65 

-0.06 

0.00 

0.14 

1.00 

1G122 

-0.54 

85 

72 

0.32 

1.09 

0.51 

2.06 

2.61 

0.00 

0.15 

0.83 

1G123 

0.13 

81 

65 

0.31 

1.14 

0.84 

1.27 

0.91 

0.00 

0.20 

0.79 

1G124 

-0.06 

71 

58 

0.34 

0.91 

-0.44 

0.65 

-0.87 

0.00 

0.46 

1.15 

1G125 

-1.40 

78 

72 

0.45 

0.92 

-0.15 

0.56 

-0.56 

0.00 

0.37 

1.08 

1G126 

0.00 

71 

71 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

1G127 

-1.44 

85 

78 

0.43 

1.03 

0.19 

0.96 

0.15 

0.00 

0.29 

0.98 

1G128 

-0.67 

96 

86 

0.35 

1.01 

0.14 

0.77 

-0.35 

0.00 

0.26 

1.02 

1G129 

-0.89 

73 

68 

0.48 

1.09 

0.37 

1.49 

0.82 

0.00 

0.11 

0.90 

1G13 

-2.41 

76 

73 

0.61 

0.84 

-0.17 

0.40 

-0.50 

0.00 

0.33 

1.11 

1G130 

-0.74 

74 

62 

0.35 

0.85 

-0.67 

0.61 

-1.06 

0.00 

0.50 

1.18 

1G131 

-0.73 

73 

66 

0.42 

0.95 

-0.06 

0.66 

-0.50 

0.00 

0.35 

1.06 

1G132 

0.00 

78 

78 

0.00 

1.00 

0.00 

1.00 

0.00 

0.00 

0.00 

1.00 

1G133 

0.93 

73 

46 

0.27 

1.14 

1.17 

1.11 

0.67 

0.00 

0.35 

0.73 

1G134 

-0.48 

79 

69 

0.36 

0.95 

-0.14 

0.72 

-0.57 

0.00 

0.37 

1.07 

1G135 

0.26 

86 

62 

0.26 

1.15 

1.21 

1.10 

0.48 

0.00 

0.29 

0.75 

1G136 

0.58 

143 

103 

0.21 

0.98 

-0.13 

0.85 

-0.73 

0.00 

0.45 

1.07 

1G137 

-1.95 

85 

81 

0.52 

0.90 

-0.09 

0.48 

-0.69 

0.00 

0.29 

1.08 

1G138 

0.23 

74 

59 

0.30 

1.11 

0.68 

1.06 

0.31 

0.00 

0.19 

0.87 

1G139 

0.36 

71 

54 

0.31 

1.14 

0.90 

1.12 

0.46 

0.00 

0.35 

0.81 

1G14 

-1.03 

78 

70 

0.40 

1.02 

0.15 

1.09 

0.35 

0.00 

0.30 

0.97 

1G140 

-1.53 

71 

67 

0.53 

0.87 

-0.18 

0.40 

-0.66 

0.00 

0.35 

1.11 

1G15 

-0.60 

85 

72 

0.33 

0.87 

-0.57 

0.53 

-1.23 

0.00 

0.50 

1.18 

1G16 

1.06 

95 

62 

0.24 

1.01 

0.09 

0.91 

-0.47 

0.00 

0.41 

1.03 

1G17 

0.19 

73 

61 

0.34 

1.04 

0.29 

0.93 

-0.03 

0.00 

0.31 

0.97 

1G18 

1.99 

75 

29 

0.27 

1.20 

1.71 

1.31 

1.54 

0.00 

0.32 

0.50 

1G19 

-0.31 

74 

58 

0.31 

1.33 

1.80 

2.59 

3.79 

0.00 

0.05 

0.42 

1G21 

-1.38 

72 

68 

0.53 

0.93 

-0.02 

0.50 

-0.50 

0.00 

0.31 

1.07 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1G210 

0.27 

162 

122 

0.20 

0.90 

-0.98 

0.82 

-0.95 

0.00 

0.45 

1.16 

1G211 

1.07 

77 

48 

0.26 

1.11 

1.15 

1.11 

0.66 

0.00 

0.30 

0.69 

1G212 

-0.65 

73 

63 

0.37 

0.96 

-0.09 

1.04 

0.23 

0.00 

0.35 

1.01 

1G213 

0.67 

79 

57 

0.28 

0.91 

-0.68 

0.74 

-1.19 

0.00 

0.48 

1.22 

1G214 

-0.46 

86 

71 

0.31 

1.37 

1.95 

1.92 

2.13 

0.00 

0.00 

0.50 

1G215 

-1.70 

83 

78 

0.47 

0.94 

-0.04 

0.58 

-0.58 

0.00 

0.28 

1.06 

1G216 

0.13 

74 

60 

0.31 

0.86 

-0.76 

0.72 

-0.88 

0.00 

0.43 

1.19 

1G217 

-1.89 

71 

68 

0.61 

0.96 

0.09 

0.47 

-0.27 

0.00 

0.26 

1.06 

1G218 

-1.20 

78 

71 

0.43 

0.98 

0.05 

1.52 

0.94 

0.00 

0.28 

0.96 

1G219 

-1.85 

71 

68 

0.61 

1.04 

0.24 

1.87 

1.05 

0.00 

0.12 

0.94 

1G22 

-0.72 

84 

72 

0.34 

0.89 

-0.45 

1.12 

0.40 

0.00 

0.42 

1.07 

1G220 

-0.25 

95 

81 

0.31 

1.02 

0.16 

0.85 

-0.27 

0.00 

0.29 

1.00 

1G221 

0.70 

145 

91 

0.19 

1.10 

1.26 

1.09 

0.74 

0.00 

0.37 

0.78 

1G222 

-0.19 

73 

64 

0.38 

0.89 

-0.38 

0.55 

-0.89 

0.00 

0.42 

1.14 

1G223 

-1.60 

75 

69 

0.45 

0.78 

-0.61 

0.41 

-1.02 

0.00 

0.44 

1.17 

1G224 

-0.62 

74 

61 

0.34 

1.11 

0.58 

1.02 

0.16 

0.00 

0.31 

0.91 

1G225 

0.20 

72 

58 

0.32 

1.11 

0.67 

1.32 

0.98 

0.00 

0.26 

0.84 

1G226 

-0.81 

77 

69 

0.39 

1.01 

0.13 

0.97 

0.11 

0.00 

0.22 

0.99 

1G227 

-1.79 

73 

69 

0.54 

0.84 

-0.27 

0.38 

-0.75 

0.00 

0.40 

1.12 

1G228 

2.96 

79 

23 

0.28 

1.44 

2.87 

2.27 

4.05 

0.00 

0.06 

0.10 

1G229 

-0.95 

148 

133 

0.29 

0.87 

-0.60 

0.56 

-1.16 

0.00 

0.42 

1.12 

1G23 

-1.00 

86 

76 

0.36 

1.04 

0.24 

1.15 

0.46 

0.00 

0.24 

0.94 

1G230 

-2.26 

83 

80 

0.60 

0.91 

-0.02 

0.41 

-0.66 

0.00 

0.28 

1.08 

1G231 

-0.43 

74 

65 

0.37 

1.04 

0.25 

1.19 

0.56 

0.00 

0.15 

0.93 

1G232 

-0.90 

71 

64 

0.42 

1.11 

0.47 

2.59 

1.97 

0.00 

0.16 

0.82 

1G233 

0.32 

77 

57 

0.29 

0.94 

-0.34 

0.79 

-0.79 

0.00 

0.50 

1.12 

1G234 

1.85 

71 

35 

0.27 

1.07 

0.64 

1.10 

0.70 

0.00 

0.42 

0.81 

1G235 

0.27 

82 

61 

0.28 

1.02 

0.21 

0.89 

-0.36 

0.00 

0.40 

1.01 

1G236 

1.11 

95 

61 

0.23 

1.08 

0.89 

1.40 

2.09 

0.00 

0.30 

0.72 

1G237 

0.44 

71 

57 

0.32 

0.84 

-0.90 

0.61 

-1.14 

0.00 

0.50 

1.24 

1G238 

-0.69 

71 

60 

0.36 

0.99 

0.01 

1.11 

0.40 

0.00 

0.33 

0.98 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1G239 

-2.14 

73 

69 

0.55 

0.76 

-0.48 

0.32 

-0.89 

0.00 

0.44 

1.16 

1G24 

-0.56 

72 

64 

0.40 

0.92 

-0.20 

0.77 

-0.31 

0.00 

0.37 

1.07 

1G240 

2.36 

76 

28 

0.27 

1.37 

2.93 

1.61 

3.27 

0.00 

0.11 

0.10 

1G25 

0.86 

73 

47 

0.27 

1.05 

0.45 

1.00 

0.07 

0.00 

0.41 

0.92 

1G26 

-0.20 

75 

64 

0.35 

0.99 

0.02 

0.82 

-0.36 

0.00 

0.31 

1.03 

1G27 

-2.84 

86 

84 

0.73 

0.99 

0.20 

0.43 

-0.40 

0.00 

0.20 

1.04 

1G28 

-0.41 

81 

67 

0.31 

1.03 

0.23 

1.01 

0.13 

0.00 

0.28 

0.97 

1G29 

0.42 

72 

55 

0.29 

0.94 

-0.35 

0.81 

-0.69 

0.00 

0.38 

1.13 

1G31 

-2.33 

71 

69 

0.73 

0.92 

0.08 

0.31 

-0.48 

0.00 

0.26 

1.08 

1G310 

-1.40 

77 

71 

0.45 

1.09 

0.37 

0.83 

-0.04 

0.00 

0.27 

0.96 

1G311 

1.92 

71 

34 

0.27 

1.09 

0.84 

1.21 

1.30 

0.00 

0.39 

0.72 

1G312 

2.43 

82 

28 

0.26 

1.43 

3.35 

1.96 

3.92 

0.00 

0.07 

-0.04 

1G313 

-0.07 

95 

79 

0.29 

0.97 

-0.12 

0.76 

-0.61 

0.00 

0.36 

1.07 

1G314 

1.24 

71 

48 

0.28 

1.33 

2.46 

1.37 

1.53 

0.00 

0.16 

0.34 

1G315 

0.14 

71 

52 

0.30 

0.99 

0.00 

0.87 

-0.49 

0.00 

0.43 

1.05 

1G316 

-0.60 

73 

60 

0.34 

1.18 

0.90 

1.31 

0.91 

0.00 

0.25 

0.80 

1G317 

0.09 

72 

59 

0.33 

1.01 

0.09 

0.92 

-0.12 

0.00 

0.37 

1.01 

1G318 

-1.47 

148 

140 

0.37 

0.93 

-0.14 

0.47 

-1.00 

0.00 

0.30 

1.08 

1G319 

0.70 

76 

53 

0.27 

1.00 

0.01 

0.93 

-0.24 

0.00 

0.36 

1.02 

1G32 

-0.18 

73 

59 

0.32 

1.03 

0.20 

0.80 

-0.51 

0.00 

0.40 

1.02 

1G320 

-0.73 

156 

138 

0.26 

1.05 

0.31 

0.96 

-0.04 

0.00 

0.23 

0.97 

1G321 

1.85 

75 

38 

0.26 

0.82 

-2.04 

0.78 

-1.81 

0.00 

0.57 

1.60 

1G322 

-1.00 

86 

76 

0.36 

0.97 

-0.06 

0.70 

-0.53 

0.00 

0.34 

1.05 

1G323 

2.49 

81 

24 

0.27 

0.91 

-0.68 

0.96 

-0.13 

0.00 

0.49 

1.12 

1G324 

2.44 

72 

26 

0.27 

1.10 

0.92 

1.13 

0.90 

0.00 

0.29 

0.75 

1G325 

-0.73 

71 

63 

0.40 

0.91 

-0.26 

0.70 

-0.39 

0.00 

0.38 

1.09 

1G326 

2.05 

77 

33 

0.26 

1.21 

1.86 

1.50 

2.51 

0.00 

0.29 

0.40 

1G327 

-0.16 

71 

59 

0.34 

0.86 

-0.66 

0.72 

-0.65 

0.00 

0.45 

1.15 

1G328 

2.03 

81 

34 

0.25 

1.03 

0.31 

1.09 

0.59 

0.00 

0.42 

0.90 

1G329 

1.17 

95 

60 

0.23 

1.09 

0.94 

1.04 

0.26 

0.00 

0.34 

0.81 

1G33 

3.17 

71 

22 

0.29 

1.19 

1.40 

1.48 

1.99 

0.00 

0.25 

0.56 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1G330 

2.05 

71 

27 

0.28 

1.11 

0.94 

1.51 

2.31 

0.00 

0.36 

0.66 

1G331 

1.97 

73 

27 

0.27 

1.18 

1.55 

1.70 

2.87 

0.00 

0.26 

0.44 

1G332 

1.74 

72 

39 

0.27 

1.12 

1.14 

1.11 

0.75 

0.00 

0.36 

0.71 

1G333 

-1.10 

76 

70 

0.44 

1.02 

0.19 

0.78 

-0.18 

0.00 

0.21 

1.00 

1G334 

0.78 

73 

48 

0.28 

1.15 

1.20 

1.22 

1.11 

0.00 

0.32 

0.69 

1G335 

1.45 

75 

44 

0.26 

0.92 

-0.87 

0.89 

-0.78 

0.00 

0.47 

1.26 

1G336 

0.84 

86 

53 

0.25 

1.01 

0.12 

1.03 

0.22 

0.00 

0.42 

0.96 

1G337 

0.92 

81 

49 

0.25 

1.07 

0.75 

1.10 

0.74 

0.00 

0.33 

0.78 

1G338 

-0.90 

72 

66 

0.44 

0.90 

-0.21 

0.55 

-0.78 

0.00 

0.34 

1.10 

1G339 

3.18 

177 

42 

0.20 

1.13 

1.24 

1.41 

2.06 

0.00 

0.28 

0.76 

1G34 

0.16 

71 

56 

0.32 

1.13 

0.78 

0.99 

0.08 

0.00 

0.35 

0.86 

1G340 

-1.88 

77 

73 

0.54 

1.02 

0.18 

0.44 

-0.53 

0.00 

0.31 

1.05 

1G341 

1.19 

71 

44 

0.28 

1.08 

0.72 

1.07 

0.44 

0.00 

0.39 

0.82 

1G342 

0.23 

81 

61 

0.28 

0.96 

-0.20 

0.80 

-0.71 

0.00 

0.44 

1.09 

1G343 

1.95 

95 

45 

0.23 

0.97 

-0.32 

1.00 

0.07 

0.00 

0.45 

1.05 

1G344 

2.73 

70 

27 

0.28 

1.24 

1.90 

1.28 

1.52 

0.00 

0.27 

0.48 

1G345 

0.40 

71 

49 

0.29 

1.29 

2.12 

1.25 

1.18 

0.00 

0.24 

0.49 

1G35 

-0.60 

73 

60 

0.34 

0.90 

-0.47 

0.67 

-0.92 

0.00 

0.48 

1.14 

1G36 

-0.41 

72 

63 

0.38 

1.15 

0.66 

1.17 

0.49 

0.00 

0.19 

0.87 

1G37 

1.44 

76 

42 

0.25 

1.14 

1.55 

1.12 

0.86 

0.00 

0.29 

0.54 

1G38 

0.38 

73 

53 

0.29 

0.96 

-0.26 

0.87 

-0.47 

0.00 

0.46 

1.09 

1G39 

1.78 

75 

39 

0.26 

1.27 

2.72 

1.28 

2.04 

0.00 

0.22 

0.13 

1MD11 

-2.40 

86 

83 

0.60 

0.79 

-0.26 

0.25 

-0.98 

0.00 

0.35 

1.14 

1MD110 

0.10 

81 

61 

0.28 

1.09 

0.67 

1.09 

0.48 

0.00 

0.27 

0.85 

1MD111 

-0.72 

72 

65 

0.41 

0.91 

-0.20 

0.92 

0.02 

0.00 

0.28 

1.06 

1MD112 

-2.33 

71 

69 

0.73 

0.98 

0.19 

1.54 

0.79 

0.00 

0.13 

0.97 

1MD113 

-0.04 

77 

61 

0.31 

1.00 

0.05 

0.98 

0.05 

0.00 

0.41 

0.99 

1MD114 

-2.12 

162 

156 

0.43 

0.90 

-0.17 

1.05 

0.29 

0.00 

0.24 

1.05 

1MD115 

-2.29 

71 

69 

0.73 

1.01 

0.23 

0.48 

-0.22 

0.00 

0.20 

1.03 

1MD116 

-1.88 

81 

77 

0.53 

0.88 

-0.14 

0.29 

-1.02 

0.00 

0.37 

1.12 

1MD117 

-0.15 

95 

80 

0.30 

0.82 

-0.98 

1.97 

2.17 

0.00 

0.41 

1.14 
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Appendix D: Item Statistics 


Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1MD118 

1.25 

70 

47 

0.28 

0.96 

-0.26 

0.94 

-0.20 

0.00 

0.44 

1.07 

1MD119 

-0.23 

144 

120 

0.24 

1.03 

0.27 

0.87 

-0.33 

0.00 

0.36 

1.00 

1MD12 

-0.82 

71 

61 

0.37 

0.84 

-0.67 

0.52 

-1.24 

0.00 

0.48 

1.19 

1MD120 

1.27 

73 

37 

0.26 

0.89 

-1.11 

1.03 

0.23 

0.00 

0.50 

1.23 

1MD121 

1.74 

72 

39 

0.27 

1.28 

2.47 

1.33 

2.09 

0.00 

0.22 

0.27 

1MD122 

-3.01 

76 

75 

1.01 

1.00 

0.32 

0.61 

0.02 

0.00 

0.10 

1.01 

1MD123 

2.50 

73 

24 

0.28 

1.02 

0.24 

1.94 

3.48 

0.00 

0.33 

0.77 

1MD124 

0.22 

75 

60 

0.31 

0.94 

-0.31 

0.83 

-0.49 

0.00 

0.38 

1.09 

1MD125 

0.72 

86 

55 

0.25 

1.09 

0.86 

1.06 

0.37 

0.00 

0.36 

0.80 

1MD126 

-0.73 

81 

70 

0.34 

1.07 

0.38 

1.15 

0.51 

0.00 

0.21 

0.92 

1MD127 

1.49 

148 

82 

0.19 

1.33 

3.75 

1.53 

3.88 

0.00 

0.26 

0.17 

1MD128 

1.10 

72 

46 

0.26 

0.94 

-0.56 

0.89 

-0.60 

0.00 

0.42 

1.18 

1MD129 

-0.06 

71 

58 

0.34 

0.99 

0.02 

0.93 

-0.06 

0.00 

0.39 

1.01 

1MD13 

-0.04 

77 

61 

0.31 

0.75 

-1.53 

0.54 

-1.63 

0.00 

0.60 

1.32 

1MD130 

0.45 

71 

53 

0.30 

0.92 

-0.51 

0.79 

-0.72 

0.00 

0.47 

1.15 

1MD131 

-0.88 

80 

71 

0.38 

0.90 

-0.33 

0.64 

-0.65 

0.00 

0.40 

1.10 

1MD132 

2.44 

95 

36 

0.24 

0.99 

-0.11 

0.93 

-0.47 

0.00 

0.46 

1.06 

1MD14 

-0.87 

70 

65 

0.48 

0.97 

0.05 

0.58 

-0.41 

0.00 

0.29 

1.05 

1MD15 

-0.57 

71 

59 

0.35 

0.95 

-0.17 

0.71 

-0.75 

0.00 

0.42 

1.10 

1MD16 

0.64 

73 

46 

0.27 

0.89 

-0.99 

0.88 

-0.63 

0.00 

0.52 

1.26 

1MD17 

1.31 

72 

45 

0.27 

1.07 

0.66 

1.07 

0.43 

0.00 

0.39 

0.85 

1MD18 

1.76 

76 

37 

0.25 

0.96 

-0.40 

0.91 

-0.64 

0.00 

0.46 

1.15 

1MD19 

-0.79 

73 

64 

0.38 

0.93 

-0.19 

0.80 

-0.27 

0.00 

0.38 

1.05 

1MD21 

-0.20 

75 

64 

0.35 

1.04 

0.27 

0.91 

-0.10 

0.00 

0.27 

0.98 

1MD210 

3.13 

86 

18 

0.30 

1.37 

1.97 

1.86 

2.32 

0.00 

0.13 

0.50 

1MD211 

0.33 

81 

58 

0.27 

1.17 

1.39 

1.28 

1.41 

0.00 

0.20 

0.64 

1MD212 

2.66 

72 

23 

0.28 

1.30 

2.22 

1.57 

2.91 

0.00 

0.06 

0.32 

1MD213 

-1.57 

71 

67 

0.53 

0.84 

-0.28 

0.34 

-0.69 

0.00 

0.36 

1.14 

1MD214 

-1.40 

77 

71 

0.45 

0.82 

-0.46 

0.73 

-0.21 

0.00 

0.41 

1.11 

1MD215 

-0.70 

71 

63 

0.40 

0.75 

-0.93 

0.40 

-1.27 

0.00 

0.50 

1.23 

1MD216 

-1.86 

80 

76 

0.53 

0.80 

-0.36 

0.28 

-1.05 

0.00 

0.40 

1.15 
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Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1MD217 

1.54 

95 

53 

0.23 

1.10 

1.17 

1.08 

0.59 

0.00 

0.34 

0.72 

1MD218 

1.85 

70 

39 

0.27 

1.14 

1.34 

1.16 

0.95 

0.00 

0.33 

0.62 

1MD219 

-0.97 

71 

62 

0.38 

0.78 

-0.89 

0.52 

-1.12 

0.00 

0.48 

1.21 

1MD22 

-1.27 

73 

65 

0.41 

0.73 

-0.98 

0.52 

-0.94 

0.00 

0.52 

1.20 

1MD220 

-0.73 

72 

65 

0.42 

0.90 

-0.26 

0.54 

-0.79 

0.00 

0.40 

1.11 

1MD221 

-0.05 

76 

62 

0.31 

0.89 

-0.58 

0.67 

-0.96 

0.00 

0.41 

1.17 

1MD222 

-0.08 

73 

58 

0.32 

0.99 

0.02 

0.94 

-0.08 

0.00 

0.40 

1.01 

1MD223 

0.66 

75 

55 

0.28 

1.11 

0.81 

1.05 

0.28 

0.00 

0.28 

0.84 

1MD224 

-0.66 

86 

73 

0.32 

0.87 

-0.64 

0.72 

-0.65 

0.00 

0.42 

1.14 

1MD225 

-1.68 

81 

76 

0.48 

0.89 

-0.19 

0.55 

-0.67 

0.00 

0.32 

1.09 

1MD226 

-0.73 

155 

137 

0.26 

1.04 

0.25 

0.99 

0.08 

0.00 

0.23 

0.97 

1MD227 

-0.90 

71 

65 

0.44 

0.90 

-0.21 

0.55 

-0.80 

0.00 

0.34 

1.10 

1MD228 

-1.28 

70 

65 

0.49 

0.90 

-0.18 

0.52 

-0.49 

0.00 

0.34 

1.10 

1MD229 

0.07 

146 

113 

0.22 

1.02 

0.25 

1.08 

0.42 

0.00 

0.38 

0.95 

1MD23 

-1.03 

77 

69 

0.40 

0.90 

-0.28 

0.44 

-1.11 

0.00 

0.46 

1.14 

1MD230 

-0.87 

71 

64 

0.42 

0.98 

0.04 

0.82 

-0.13 

0.00 

0.30 

1.02 

1MD231 

1.69 

80 

39 

0.25 

0.96 

-0.45 

0.93 

-0.42 

0.00 

0.48 

1.13 

1MD232 

1.90 

95 

46 

0.23 

1.08 

0.98 

1.07 

0.57 

0.00 

0.36 

0.76 

1MD24 

1.25 

70 

47 

0.28 

0.86 

-1.22 

0.73 

-1.23 

0.00 

0.54 

1.34 

1MD25 

-0.14 

71 

55 

0.31 

0.76 

-1.51 

0.69 

-1.11 

0.00 

0.55 

1.32 

1MD26 

-0.09 

73 

55 

0.30 

0.91 

-0.53 

0.75 

-0.93 

0.00 

0.49 

1.16 

1MD27 

-0.15 

72 

61 

0.35 

0.91 

-0.36 

0.69 

-0.72 

0.00 

0.43 

1.11 

1MD28 

-0.92 

76 

69 

0.41 

0.88 

-0.31 

0.56 

-0.76 

0.00 

0.35 

1.12 

1MD29 

0.47 

73 

52 

0.29 

1.09 

0.71 

1.09 

0.46 

0.00 

0.35 

0.85 

1MD31 

-1.73 

75 

72 

0.60 

0.92 

0.02 

0.55 

-0.37 

0.00 

0.25 

1.06 

1MD310 

0.73 

148 

105 

0.20 

0.97 

-0.35 

0.84 

-0.95 

0.00 

0.43 

1.11 

1MD311 

1.73 

86 

38 

0.24 

0.97 

-0.24 

1.05 

0.36 

0.00 

0.46 

1.02 

1MD312 

-0.41 

81 

67 

0.31 

0.95 

-0.23 

0.83 

-0.50 

0.00 

0.36 

1.07 

1MD313 

0.59 

71 

52 

0.28 

1.09 

0.74 

1.26 

1.12 

0.00 

0.18 

0.75 

1MD314 

-0.02 

70 

57 

0.34 

0.92 

-0.40 

1.38 

0.98 

0.00 

0.40 

1.02 

1MD315 

-0.43 

144 

125 

0.26 

1.11 

0.70 

1.69 

1.87 

0.00 

0.17 

0.84 
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Item ID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1MD316 

1.57 

77 

40 

0.26 

1.11 

1.01 

1.09 

0.60 

0.00 

0.40 

0.75 

1MD317 

1.85 

71 

35 

0.27 

1.07 

0.63 

1.07 

0.46 

0.00 

0.42 

0.84 

1MD318 

-0.88 

80 

71 

0.38 

0.92 

-0.26 

0.64 

-0.66 

0.00 

0.40 

1.10 

1MD319 

1.75 

93 

48 

0.23 

1.02 

0.24 

0.99 

-0.05 

0.00 

0.42 

0.96 

1MD32 

-0.02 

70 

60 

0.36 

0.99 

0.05 

0.88 

-0.11 

0.00 

0.32 

1.01 

1MD320 

-0.67 

70 

59 

0.36 

0.84 

-0.68 

0.68 

-0.79 

0.00 

0.46 

1.17 

1MD321 

-1.87 

73 

68 

0.50 

0.79 

-0.50 

0.33 

-1.02 

0.00 

0.47 

1.17 

1MD322 

-2.87 

72 

71 

1.02 

0.98 

0.30 

0.35 

-0.21 

0.00 

0.17 

1.04 

1MD323 

-1.60 

153 

144 

0.36 

1.10 

0.43 

0.93 

0.04 

0.00 

0.17 

0.95 

1MD324 

-1.31 

76 

71 

0.47 

0.92 

-0.10 

0.58 

-0.49 

0.00 

0.29 

1.08 

1MD325 

2.58 

73 

23 

0.28 

0.90 

-0.79 

0.85 

-0.63 

0.00 

0.50 

1.19 

1MD326 

-0.95 

74 

68 

0.44 

0.86 

-0.34 

0.66 

-0.47 

0.00 

0.34 

1.10 

1MD327 

-0.11 

86 

67 

0.28 

0.90 

-0.65 

0.83 

-0.52 

0.00 

0.44 

1.14 

1MD328 

-0.85 

81 

71 

0.35 

0.95 

-0.13 

0.95 

-0.01 

0.00 

0.31 

1.04 

1MD329 

-1.10 

71 

66 

0.47 

0.92 

-0.09 

0.58 

-0.61 

0.00 

0.30 

1.08 

1MD33 

-0.02 

70 

57 

0.34 

1.15 

0.86 

1.71 

1.61 

0.00 

0.26 

0.75 

1MD410 

0.20 

149 

116 

0.21 

1.13 

1.17 

1.17 

0.88 

0.00 

0.26 

0.82 

1MD421 

2.62 

167 

62 

0.18 

0.91 

-1.12 

0.89 

-0.92 

0.00 

0.52 

1.18 

1NBT21 

1.30 

77 

44 

0.26 

0.79 

-1.99 

0.70 

-1.99 

0.00 

0.63 

1.50 

1NBT22 

0.45 

71 

53 

0.30 

0.92 

-0.49 

0.75 

-0.91 

0.00 

0.48 

1.17 

1NBT23 

0.64 

80 

55 

0.27 

0.92 

-0.64 

0.88 

-0.53 

0.00 

0.48 

1.16 

1NBT24 

-0.13 

93 

78 

0.30 

0.85 

-0.84 

0.57 

-1.25 

0.00 

0.46 

1.20 

1NBT25 

-0.15 

70 

61 

0.38 

0.91 

-0.29 

0.80 

-0.24 

0.00 

0.36 

1.08 

1NBT31 

0.68 

70 

45 

0.28 

1.03 

0.28 

1.07 

0.42 

0.00 

0.41 

0.91 

1NBT310 

1.06 

73 

40 

0.26 

1.10 

0.99 

1.19 

1.20 

0.00 

0.36 

0.69 

1NBT311 

1.31 

72 

45 

0.27 

0.86 

-1.25 

0.79 

-1.25 

0.00 

0.57 

1.33 

1NBT312 

0.05 

76 

61 

0.31 

0.94 

-0.28 

0.83 

-0.46 

0.00 

0.36 

1.08 

1NBT313 

-0.29 

73 

60 

0.33 

0.90 

-0.47 

0.82 

-0.39 

0.00 

0.45 

1.11 

1NBT314 

0.82 

74 

52 

0.28 

1.07 

0.58 

0.99 

0.01 

0.00 

0.33 

0.90 

1NBT315 

0.96 

86 

51 

0.25 

1.03 

0.31 

0.95 

-0.24 

0.00 

0.42 

0.97 

1NBT316 

0.53 

81 

55 

0.26 

1.07 

0.66 

1.01 

0.14 

0.00 

0.33 

0.87 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1NBT317 

0.89 

71 

48 

0.27 

1.08 

0.79 

1.12 

0.68 

0.00 

0.24 

0.77 

1NBT318 

1.29 

70 

43 

0.29 

1.02 

0.20 

1.02 

0.19 

0.00 

0.48 

0.94 

1NBT319 

0.23 

77 

58 

0.30 

1.06 

0.41 

0.84 

-0.54 

0.00 

0.43 

0.99 

1NBT32 

1.11 

71 

45 

0.28 

0.88 

-1.04 

0.84 

-0.81 

0.00 

0.53 

1.27 

1NBT320 

0.71 

80 

54 

0.27 

1.33 

2.59 

1.72 

2.99 

0.00 

0.13 

0.22 

1NBT321 

0.88 

92 

63 

0.25 

0.97 

-0.26 

0.86 

-0.61 

0.00 

0.43 

1.10 

1NBT322 

-0.65 

70 

64 

0.44 

0.94 

-0.07 

0.71 

-0.26 

0.00 

0.30 

1.05 

1NBT323 

1.14 

70 

39 

0.27 

1.09 

0.85 

1.26 

1.63 

0.00 

0.38 

0.69 

1NBT324 

0.85 

73 

43 

0.27 

0.87 

-1.26 

0.84 

-0.96 

0.00 

0.54 

1.33 

1NBT325 

0.75 

72 

52 

0.29 

0.95 

-0.35 

0.83 

-0.67 

0.00 

0.47 

1.12 

1NBT326 

-0.76 

76 

68 

0.39 

0.90 

-0.30 

0.57 

-0.82 

0.00 

0.35 

1.12 

1NBT327 

0.86 

73 

47 

0.27 

1.06 

0.53 

1.12 

0.67 

0.00 

0.39 

0.85 

1NBT328 

1.13 

144 

90 

0.19 

0.99 

-0.11 

0.94 

-0.41 

0.00 

0.46 

1.04 

1NBT329 

1.42 

150 

85 

0.18 

1.05 

0.70 

1.17 

1.54 

0.00 

0.38 

0.81 

1NBT33 

-0.08 

74 

62 

0.33 

0.75 

-1.26 

0.52 

-1.54 

0.00 

0.51 

1.28 

1NBT330 

0.40 

86 

60 

0.26 

1.04 

0.38 

0.95 

-0.18 

0.00 

0.38 

0.96 

1NBT331 

0.10 

81 

61 

0.28 

1.09 

0.65 

1.01 

0.10 

0.00 

0.29 

0.90 

1NBT332 

-0.02 

70 

58 

0.33 

1.00 

0.05 

0.92 

-0.14 

0.00 

0.27 

1.01 

1NBT333 

0.41 

70 

53 

0.31 

0.97 

-0.12 

0.78 

-0.67 

0.00 

0.47 

1.09 

1NBT334 

0.49 

77 

55 

0.28 

1.01 

0.14 

0.90 

-0.34 

0.00 

0.45 

1.01 

1NBT335 

-0.28 

71 

60 

0.35 

1.12 

0.63 

1.05 

0.27 

0.00 

0.25 

0.88 

1NBT336 

0.92 

80 

51 

0.26 

1.08 

0.76 

1.18 

0.98 

0.00 

0.36 

0.78 

1NBT337 

1.03 

89 

59 

0.25 

0.98 

-0.20 

0.90 

-0.43 

0.00 

0.42 

1.07 

1NBT338 

-1.12 

70 

66 

0.53 

0.93 

-0.02 

0.85 

0.08 

0.00 

0.26 

1.04 

1NBT339 

1.51 

70 

34 

0.27 

1.46 

3.74 

1.91 

4.72 

0.00 

0.11 

-0.37 

1NBT34 

0.85 

73 

43 

0.27 

1.06 

0.63 

1.12 

0.73 

0.00 

0.38 

0.80 

1NBT340 

0.58 

72 

54 

0.30 

1.06 

0.47 

1.09 

0.42 

0.00 

0.35 

0.90 

1NBT35 

-0.15 

76 

63 

0.32 

1.07 

0.44 

1.32 

0.93 

0.00 

0.18 

0.86 

1NBT36 

-0.79 

73 

64 

0.38 

0.98 

0.02 

0.77 

-0.35 

0.00 

0.36 

1.03 

1NBT37 

1.22 

219 

133 

0.16 

1.05 

0.73 

1.18 

1.68 

0.00 

0.43 

0.84 

1NBT38 

1.26 

74 

46 

0.26 

1.05 

0.50 

1.00 

0.04 

0.00 

0.37 

0.90 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1NBT39 

0.53 

86 

58 

0.25 

1.11 

1.02 

1.06 

0.37 

0.00 

0.33 

0.79 

1NBT51 

-0.73 

81 

70 

0.34 

1.07 

0.40 

1.63 

1.57 

0.00 

0.15 

0.86 

1NBT510 

-0.02 

70 

58 

0.33 

0.98 

-0.01 

1.10 

0.39 

0.00 

0.25 

0.99 

1NBT511 

0.87 

70 

48 

0.30 

0.97 

-0.18 

0.82 

-0.74 

0.00 

0.51 

1.11 

1NBT512 

-0.25 

77 

63 

0.33 

1.01 

0.14 

1.21 

0.67 

0.00 

0.36 

0.93 

1NBT513 

1.63 

71 

38 

0.27 

1.03 

0.30 

0.97 

-0.14 

0.00 

0.45 

0.96 

1NBT514 

0.26 

80 

60 

0.29 

0.94 

-0.39 

0.83 

-0.60 

0.00 

0.45 

1.11 

1NBT515 

0.88 

88 

61 

0.25 

1.01 

0.17 

1.07 

0.39 

0.00 

0.36 

0.94 

1NBT516 

1.41 

70 

45 

0.28 

0.84 

-1.43 

0.71 

-1.48 

0.00 

0.57 

1.41 

1NBT517 

0.08 

70 

52 

0.30 

1.07 

0.53 

1.08 

0.39 

0.00 

0.36 

0.90 

1NBT518 

0.49 

73 

48 

0.28 

1.21 

1.70 

1.23 

1.15 

0.00 

0.28 

0.56 

1NBT519 

0.40 

72 

56 

0.31 

1.06 

0.41 

1.63 

1.87 

0.00 

0.28 

0.82 

1NBT52 

2.09 

76 

32 

0.26 

1.06 

0.59 

1.12 

0.88 

0.00 

0.38 

0.81 

1NBT520 

-0.08 

73 

58 

0.32 

0.91 

-0.46 

0.88 

-0.27 

0.00 

0.45 

1.09 

1NBT521 

0.05 

73 

60 

0.33 

0.86 

-0.74 

0.63 

-1.17 

0.00 

0.45 

1.20 

1NBT522 

1.20 

86 

47 

0.24 

0.88 

-1.35 

0.96 

-0.22 

0.00 

0.52 

1.30 

1NBT523 

0.37 

177 

133 

0.19 

1.07 

0.76 

1.02 

0.17 

0.00 

0.33 

0.91 

1NBT524 

0.10 

81 

61 

0.28 

0.86 

-1.03 

0.70 

-1.45 

0.00 

0.48 

1.27 

1NBT525 

0.78 

70 

49 

0.28 

0.88 

-1.00 

0.95 

-0.17 

0.00 

0.43 

1.23 

1NBT526 

0.69 

70 

50 

0.30 

1.04 

0.33 

0.90 

-0.30 

0.00 

0.45 

0.98 

1NBT527 

0.05 

77 

60 

0.31 

1.09 

0.60 

0.99 

0.06 

0.00 

0.37 

0.90 

1NBT528 

1.19 

70 

43 

0.28 

1.05 

0.46 

1.11 

0.64 

0.00 

0.40 

0.85 

1NBT529 

0.06 

169 

128 

0.19 

1.07 

0.78 

1.06 

0.41 

0.00 

0.30 

0.89 

1NBT53 

0.42 

80 

58 

0.28 

1.03 

0.23 

0.93 

-0.20 

0.00 

0.40 

0.98 

1NBT530 

0.88 

88 

61 

0.25 

1.02 

0.18 

1.01 

0.10 

0.00 

0.37 

0.96 

1NBT531 

0.45 

70 

56 

0.32 

1.15 

0.89 

1.28 

0.82 

0.00 

0.22 

0.78 

1NBT532 

0.99 

70 

41 

0.28 

0.94 

-0.54 

0.98 

-0.07 

0.00 

0.49 

1.13 

1NBT533 

-0.60 

73 

60 

0.34 

1.01 

0.12 

0.92 

-0.10 

0.00 

0.39 

1.01 

1NBT534 

0.67 

72 

53 

0.29 

0.81 

-1.33 

0.68 

-1.34 

0.00 

0.57 

1.31 

1NBT535 

1.25 

76 

45 

0.26 

1.02 

0.30 

0.95 

-0.26 

0.00 

0.39 

0.97 

1NBT536 

0.78 

73 

48 

0.28 

0.86 

-1.13 

0.75 

-1.30 

0.00 

0.56 

1.31 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

1NBT537 

1.07 

73 

48 

0.27 

0.97 

-0.26 

1.01 

0.14 

0.00 

0.40 

1.05 

1NBT538 

0.78 

86 

54 

0.25 

1.06 

0.65 

1.06 

0.38 

0.00 

0.38 

0.85 

1NBT539 

0.33 

81 

58 

0.27 

1.15 

1.21 

1.20 

1.04 

0.00 

0.23 

0.71 

1NBT54 

1.62 

70 

37 

0.26 

0.99 

-0.08 

0.97 

-0.18 

0.00 

0.38 

1.04 

1NBT540 

1.45 

70 

41 

0.28 

1.00 

0.05 

1.02 

0.20 

0.00 

0.51 

0.99 

1NBT55 

-0.25 

77 

63 

0.33 

0.80 

-1.05 

0.83 

-0.36 

0.00 

0.52 

1.19 

1NBT56 

-1.44 

146 

135 

0.33 

0.90 

-0.34 

0.96 

0.09 

0.00 

0.33 

1.04 

1NBT57 

1.19 

70 

43 

0.28 

1.08 

0.69 

1.15 

0.88 

0.00 

0.37 

0.77 

1NBT58 

-0.18 

80 

65 

0.31 

0.81 

-1.08 

0.60 

-1.25 

0.00 

0.52 

1.24 

1NBT59 

1.59 

88 

49 

0.24 

0.92 

-0.82 

0.88 

-0.79 

0.00 

0.49 

1.23 

1NBT61 

1.09 

70 

49 

0.29 

0.98 

-0.10 

0.82 

-0.69 

0.00 

0.45 

1.10 

1NBT610 

1.73 

70 

31 

0.27 

0.99 

-0.09 

1.13 

0.83 

0.00 

0.46 

0.97 

1NBT611 

0.71 

73 

45 

0.27 

0.93 

-0.60 

0.88 

-0.65 

0.00 

0.49 

1.18 

1NBT612 

0.92 

72 

50 

0.28 

1.12 

0.96 

1.22 

1.02 

0.00 

0.31 

0.74 

1NBT613 

0.48 

76 

56 

0.28 

1.05 

0.45 

0.99 

0.05 

0.00 

0.30 

0.92 

1NBT614 

0.71 

73 

49 

0.28 

0.98 

-0.12 

0.95 

-0.17 

0.00 

0.45 

1.04 

1NBT615 

0.15 

73 

59 

0.32 

0.80 

-1.16 

0.60 

-1.38 

0.00 

0.49 

1.27 

1NBT616 

0.59 

86 

57 

0.25 

0.87 

-1.25 

0.81 

-0.98 

0.00 

0.51 

1.29 

1NBT617 

0.94 

80 

48 

0.25 

1.08 

0.87 

1.10 

0.78 

0.00 

0.33 

0.75 

1NBT618 

2.09 

70 

30 

0.26 

0.94 

-0.65 

0.92 

-0.60 

0.00 

0.45 

1.21 

1NBT619 

0.69 

70 

50 

0.30 

0.95 

-0.35 

0.77 

-0.86 

0.00 

0.51 

1.14 

1NBT631 

1.77 

144 

74 

0.19 

1.02 

0.27 

1.03 

0.32 

0.00 

0.44 

0.94 

1NBT639 

1.17 

149 

89 

0.19 

1.05 

0.75 

1.05 

0.45 

0.00 

0.38 

0.86 

1NBT65 

0.06 

177 

141 

0.20 

0.91 

-0.79 

0.79 

-0.96 

0.00 

0.43 

1.12 

10A21 

0.32 

77 

57 

0.29 

0.92 

-0.49 

0.89 

-0.34 

0.00 

0.49 

1.12 

1OA210 

0.72 

70 

49 

0.29 

1.13 

0.99 

0.99 

0.03 

0.00 

0.35 

0.82 

10A211 

0.26 

80 

60 

0.29 

0.96 

-0.26 

0.91 

-0.26 

0.00 

0.43 

1.08 

10A212 

-0.53 

88 

78 

0.35 

0.93 

-0.22 

0.68 

-0.56 

0.00 

0.34 

1.08 

10A213 

-0.20 

161 

132 

0.22 

1.00 

0.03 

0.97 

-0.04 

0.00 

0.34 

1.01 

10A214 

1.25 

70 

47 

0.28 

0.89 

-0.92 

0.74 

-1.18 

0.00 

0.53 

1.28 

10A215 

0.17 

70 

51 

0.30 

0.82 

-1.25 

0.69 

-1.36 

0.00 

0.55 

1.31 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10A216 

-0.18 

73 

56 

0.31 

1.04 

0.32 

0.98 

0.04 

0.00 

0.38 

0.96 

10A217 

0.75 

72 

52 

0.29 

0.88 

-0.88 

0.71 

-1.27 

0.00 

0.54 

1.25 

10A218 

0.05 

76 

61 

0.31 

0.87 

-0.74 

0.76 

-0.68 

0.00 

0.41 

1.17 

10A219 

-0.38 

148 

125 

0.25 

0.87 

-0.85 

0.63 

-1.32 

0.00 

0.47 

1.15 

10A22 

1.15 

73 

43 

0.27 

1.20 

1.74 

1.26 

1.53 

0.00 

0.29 

0.51 

1OA220 

0.43 

73 

56 

0.30 

0.79 

-1.47 

0.63 

-1.52 

0.00 

0.52 

1.35 

10A221 

0.40 

86 

60 

0.26 

0.95 

-0.41 

0.90 

-0.37 

0.00 

0.44 

1.11 

10A222 

0.01 

145 

108 

0.21 

0.91 

-0.82 

0.84 

-0.89 

0.00 

0.47 

1.14 

10A223 

0.62 

80 

53 

0.26 

0.88 

-1.21 

0.78 

-1.43 

0.00 

0.50 

1.34 

10A224 

0.86 

70 

48 

0.27 

0.89 

-1.04 

0.79 

-1.11 

0.00 

0.46 

1.31 

10A225 

0.78 

70 

49 

0.30 

0.89 

-0.81 

0.74 

-1.06 

0.00 

0.55 

1.23 

10A23 

-0.14 

77 

62 

0.32 

0.72 

-1.66 

0.51 

-1.63 

0.00 

0.61 

1.33 

10A24 

0.80 

70 

48 

0.29 

1.08 

0.65 

1.06 

0.33 

0.00 

0.37 

0.86 

10A25 

0.01 

80 

63 

0.30 

0.93 

-0.36 

0.88 

-0.32 

0.00 

0.42 

1.08 

10A26 

-0.06 

87 

73 

0.31 

0.86 

-0.77 

0.65 

-0.93 

0.00 

0.44 

1.18 

10A27 

1.01 

70 

50 

0.29 

0.96 

-0.26 

0.78 

-0.80 

0.00 

0.46 

1.13 

10A28 

0.52 

70 

47 

0.29 

0.69 

-2.70 

0.57 

-2.51 

0.00 

0.65 

1.63 

10A29 

0.00 

73 

54 

0.30 

1.12 

0.81 

1.04 

0.24 

0.00 

0.34 

0.85 

10A41 

0.58 

72 

54 

0.30 

0.83 

-1.13 

0.63 

-1.50 

0.00 

0.56 

1.30 

1OA410 

0.48 

76 

56 

0.28 

0.90 

-0.74 

0.77 

-0.92 

0.00 

0.44 

1.21 

10A411 

0.02 

73 

57 

0.31 

0.79 

-1.31 

0.55 

-1.66 

0.00 

0.59 

1.32 

10A412 

-0.44 

73 

64 

0.37 

0.83 

-0.65 

0.54 

-1.12 

0.00 

0.43 

1.18 

10A413 

-0.18 

146 

118 

0.23 

0.95 

-0.32 

0.77 

-0.90 

0.00 

0.44 

1.09 

10A414 

0.26 

86 

62 

0.26 

0.86 

-1.15 

0.80 

-0.81 

0.00 

0.49 

1.24 

10A415 

-0.50 

80 

67 

0.32 

0.95 

-0.21 

0.71 

-0.89 

0.00 

0.38 

1.10 

10A416 

0.78 

70 

49 

0.28 

1.08 

0.73 

1.12 

0.63 

0.00 

0.23 

0.80 

10A417 

-0.26 

70 

59 

0.36 

0.80 

-1.01 

0.51 

-1.17 

0.00 

0.51 

1.25 

10A418 

0.14 

77 

59 

0.30 

0.92 

-0.47 

0.73 

-0.91 

0.00 

0.50 

1.14 

10A419 

-0.28 

70 

59 

0.35 

0.95 

-0.17 

0.77 

-0.44 

0.00 

0.38 

1.07 

10A42 

2.36 

78 

28 

0.27 

1.09 

0.83 

1.25 

1.24 

0.00 

0.36 

0.74 

1OA420 

1.05 

87 

58 

0.25 

1.01 

0.16 

0.88 

-0.54 

0.00 

0.40 

1.03 
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ItemID 

Difficulty 

n 

Score 

Error 

IN.MSQ 

IN.ZSTD 

OUT.MSQ 

OUT.ZSTD 

Displace 

PTME 

Discrim 

10A421 

-0.30 

70 

62 

0.40 

1.03 

0.19 

0.88 

-0.04 

0.00 

0.27 

0.98 

10A422 

0.35 

70 

49 

0.29 

1.05 

0.40 

1.04 

0.25 

0.00 

0.39 

0.91 

10A423 

0.48 

153 

111 

0.20 

0.94 

-0.58 

0.85 

-0.84 

0.00 

0.46 

1.12 

10A424 

0.00 

73 

54 

0.30 

0.82 

-1.22 

0.80 

-0.73 

0.00 

0.54 

1.25 

10A425 

-0.21 

168 

134 

0.21 

0.90 

-0.93 

0.78 

-1.08 

0.00 

0.43 

1.15 

10A43 

1.88 

72 

37 

0.27 

1.09 

0.86 

1.10 

0.71 

0.00 

0.38 

0.78 

10A44 

1.83 

76 

36 

0.25 

1.20 

2.14 

1.23 

1.67 

0.00 

0.25 

0.34 

10A45 

-0.08 

73 

58 

0.32 

1.05 

0.36 

0.85 

-0.38 

0.00 

0.38 

0.98 

10A46 

1.90 

73 

36 

0.26 

1.38 

3.72 

1.64 

4.10 

0.00 

0.10 

-0.38 

10A47 

0.33 

86 

61 

0.26 

0.85 

-1.27 

0.91 

-0.34 

0.00 

0.49 

1.24 

10A48 

-0.50 

80 

67 

0.32 

0.82 

-0.92 

0.65 

-1.12 

0.00 

0.46 

1.20 

10A49 

0.55 

70 

52 

0.29 

1.00 

0.01 

1.01 

0.10 

0.00 

0.31 

1.00 

10A51 

0.42 

69 

52 

0.32 

0.89 

-0.71 

0.89 

-0.25 

0.00 

0.49 

1.14 

10A719 

-0.27 

149 

124 

0.23 

0.89 

-0.76 

0.93 

-0.16 

0.00 

0.40 

1.10 

10A811 

0.16 

155 

120 

0.21 

1.04 

0.41 

1.49 

2.36 

0.00 

0.25 

0.87 

10A812 

2.75 

167 

58 

0.18 

1.37 

4.08 

1.69 

4.74 

0.00 

0.12 

0.19 



easyCBM CCSS First Grade Math Measure Development 


188 

Appendix E: Distractor Statistics 


Appendix E: Distractor Statistics for Full CCSS Item Bank 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10001 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10001 

A 

1 

21 

91 

1.19 

0.23 

1.04 

0.35 

10001 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10001 

C 

0 

1 

4 

0.03 

0.00 

0.55 

-0.21 

10001 

D 

0 

1 

4 

-0.27 

0.00 

0.41 

-0.27 

10002 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10002 

A 

1 

21 

88 

1.25 

0.34 

0.95 

0.40 

10002 

B 

0 

1 

4 

-0.58 

0.00 

0.42 

-0.21 

10002 

C 

0 

2 

8 

-0.66 

0.01 

0.39 

-0.32 

10002 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10003 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10003 

A 

1 

20 

83 

1.27 

0.31 

0.88 

0.51 

10003 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10003 

C 

0 

3 

13 

-0.66 

0.74 

0.58 

-0.40 

10003 

D 

0 

1 

4 

-1.22 

0.00 

0.22 

-0.30 

10004 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10004 

A 

1 

23 

96 

1.52 

0.29 

0.98 

0.25 

10004 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10004 

C 

0 

1 

4 

-0.18 

0.00 

0.40 

-0.25 

10004 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10005 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10005 

A 

-1 

24 

100 

1.25 

0.35 

0.00 

0.00 

10005 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10005 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10005 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10006 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10006 

A 

1 

21 

88 

1.40 

0.38 

0.81 

0.47 

10006 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10006 

C 

0 

1 

4 

-1.72 

0.00 

0.16 

-0.32 

10006 

D 

0 

2 

8 

-0.93 

0.01 

0.36 

-0.33 

10007 

* 

-1 

1253 

66 

1.65 

0.04 

0.00 

0.13 

10007 

A 

1 

570 

89 

1.48 

0.06 

0.96 

0.35 

10007 

B 

0 

31 

5 

0.07 

0.31 

2.39 

-0.17 

10007 

C 

0 

27 

4 

-0.10 

0.12 

0.68 

-0.18 

10007 

D 

0 

13 

2 

-1.82 

0.43 

0.22 

-0.28 

10008 

* 

-1 

1873 

99 

1.54 

0.03 

0.00 

0.09 

10008 

A 

1 

11 

52 

0.45 

0.68 

10.16 

0.05 

10008 

B 

0 

6 

29 

0.58 

0.22 

1.31 

0.08 

10008 

C 

0 

1 

5 

-0.64 

0.00 

0.34 

-0.13 

10008 

D 

0 

3 

14 

-0.02 

0.89 

1.42 

-0.09 

10009 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

10009 

A 

1 

14 

61 

1.22 

0.52 

3.65 

0.32 

10009 

B 

0 

8 

35 

-0.21 

0.38 

0.94 

-0.41 

10009 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10009 

D 

0 

1 

4 

2.39 

0.00 

6.54 

0.20 

10010 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.02 

10010 

A 

1 

16 

76 

1.82 

0.29 

0.67 

0.65 

10010 

B 

0 

4 

19 

0.10 

0.25 

0.50 

-0.36 

10010 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10010 

D 

0 

1 

5 

-3.21 

0.00 

0.02 

-0.64 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10011 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10011 

A 

1 

20 

83 

1.87 

0.26 

0.83 

0.52 

10011 

B 

0 

3 

13 

-0.66 

0.37 

0.22 

-0.63 

10011 

C 

0 

1 

4 

2.01 

0.00 

2.78 

0.07 

10011 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10012 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10012 

A 

1 

19 

79 

1.79 

0.37 

0.99 

0.34 

10012 

B 

0 

1 

4 

-0.66 

0.00 

0.20 

-0.30 

10012 

C 

0 

2 

8 

0.48 

0.07 

0.64 

-0.20 

10012 

D 

0 

2 

8 

1.12 

0.42 

1.32 

-0.08 

10013 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10013 

A 

1 

9 

38 

2.53 

0.71 

0.65 

0.63 

10013 

B 

0 

10 

42 

0.24 

0.26 

0.92 

-0.40 

10013 

C 

0 

1 

4 

1.64 

0.00 

2.77 

0.07 

10013 

D 

0 

4 

17 

-0.23 

0.30 

0.48 

-0.33 

10014 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10014 

A 

1 

17 

71 

1.46 

0.31 

1.09 

0.50 

10014 

B 

0 

2 

8 

-0.06 

0.66 

0.55 

-0.26 

10014 

C 

0 

2 

8 

-0.21 

0.54 

0.44 

-0.30 

10014 

D 

0 

3 

13 

0.32 

0.29 

0.70 

-0.22 

10015 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10015 

A 

1 

19 

79 

1.58 

0.36 

0.88 

0.41 

10015 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10015 

C 

0 

1 

4 

-0.61 

0.00 

0.31 

-0.24 

10015 

D 

0 

4 

17 

0.06 

0.79 

1.21 

-0.32 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10016 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10016 

A 

1 

21 

91 

1.61 

0.26 

0.96 

0.67 

10016 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10016 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10016 

D 

0 

2 

9 

-2.64 

2.59 

0.36 

-0.67 

10017 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10017 

A 

1 

16 

70 

2.06 

0.35 

0.69 

0.63 

10017 

B 

0 

3 

13 

-0.15 

0.49 

0.46 

-0.36 

10017 

C 

0 

1 

4 

0.37 

0.00 

0.61 

-0.13 

10017 

D 

0 

3 

13 

-0.47 

1.04 

0.55 

-0.43 

10018 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.04 

10018 

A 

1 

20 

83 

2.16 

0.35 

1.10 

0.18 

10018 

B 

0 

2 

8 

2.61 

0.41 

4.00 

0.11 

10018 

C 

0 

1 

4 

1.33 

0.00 

1.03 

-0.09 

10018 

D 

0 

1 

4 

-0.92 

0.00 

0.11 

-0.40 

10019 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.05 

10019 

A 

1 

14 

61 

1.31 

0.34 

0.93 

0.37 

10019 

B 

0 

4 

17 

0.46 

1.19 

7.27 

-0.14 

10019 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10019 

D 

0 

5 

22 

0.06 

0.15 

0.60 

-0.31 

10020 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10020 

A 

1 

13 

54 

2.36 

0.39 

0.84 

0.59 

10020 

B 

0 

4 

17 

0.55 

0.45 

0.58 

-0.33 

10020 

C 

0 

2 

8 

0.58 

0.39 

0.49 

-0.21 

10020 

D 

0 

5 

21 

0.82 

0.51 

1.12 

-0.28 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10021 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10021 

A 

1 

18 

78 

1.39 

0.37 

1.00 

0.40 

10021 

B 

0 

1 

4 

0.32 

0.00 

0.84 

-0.11 

10021 

C 

0 

2 

9 

-0.13 

0.52 

0.60 

-0.25 

10021 

D 

0 

2 

9 

-0.14 

0.13 

0.53 

-0.25 

10022 

* 

-1 

1726 

91 

1.52 

0.03 

0.00 

-0.01 

10022 

A 

1 

147 

88 

1.77 

0.10 

0.86 

0.45 

10022 

B 

0 

14 

8 

0.21 

0.29 

0.70 

-0.31 

10022 

C 

0 

4 

2 

-0.49 

0.50 

0.30 

-0.25 

10022 

D 

0 

3 

2 

-0.24 

0.11 

0.29 

-0.19 

10023 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10023 

A 

1 

19 

79 

1.76 

0.36 

1.12 

0.54 

10023 

B 

0 

1 

4 

-1.21 

0.00 

0.16 

-0.32 

10023 

C 

0 

4 

17 

-0.21 

0.13 

0.44 

-0.42 

10023 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10024 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10024 

A 

1 

18 

75 

2.06 

0.38 

0.90 

0.55 

10024 

B 

0 

4 

17 

-0.49 

0.43 

0.40 

-0.53 

10024 

C 

0 

1 

4 

0.44 

0.00 

0.72 

-0.13 

10024 

D 

0 

1 

4 

0.98 

0.00 

1.23 

-0.07 

10025 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10025 

A 

1 

16 

67 

1.37 

0.39 

1.76 

0.20 

10025 

B 

0 

4 

17 

1.40 

0.56 

2.47 

0.07 

10025 

C 

0 

4 

17 

0.12 

0.52 

0.73 

-0.33 

10025 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10026 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10026 

A 

1 

9 

38 

3.08 

0.72 

1.25 

0.57 

10026 

B 

0 

8 

33 

0.87 

0.39 

1.09 

-0.32 

10026 

C 

0 

6 

25 

1.02 

0.58 

1.85 

-0.21 

10026 

D 

0 

1 

4 

0.18 

0.00 

0.34 

-0.17 

10027 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

10027 

A 

1 

13 

59 

1.74 

0.48 

1.19 

0.46 

10027 

B 

0 

5 

23 

0.48 

0.29 

0.92 

-0.24 

10027 

C 

0 

2 

9 

0.72 

0.36 

1.06 

-0.09 

10027 

D 

0 

2 

9 

-0.52 

0.43 

0.32 

-0.35 

10028 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

-0.01 

10028 

A 

1 

11 

52 

2.17 

0.48 

1.21 

0.35 

10028 

B 

0 

1 

5 

0.84 

0.00 

0.51 

-0.13 

10028 

C 

0 

7 

33 

1.18 

0.56 

2.21 

-0.24 

10028 

D 

0 

2 

10 

1.20 

0.37 

0.78 

-0.11 

10029 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

0.00 

10029 

A 

1 

17 

81 

2.00 

0.48 

0.90 

0.47 

10029 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10029 

C 

0 

3 

14 

-0.62 

0.30 

0.34 

-0.45 

10029 

D 

0 

1 

5 

0.55 

0.00 

1.01 

-0.11 

10030 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10030 

A 

1 

8 

33 

1.25 

0.38 

1.73 

0.09 

10030 

B 

0 

6 

25 

2.10 

0.40 

3.19 

0.53 

10030 

C 

0 

5 

21 

0.56 

0.33 

0.61 

-0.26 

10030 

D 

0 

5 

21 

0.25 

0.28 

0.42 

-0.41 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10031 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10031 

A 

1 

14 

61 

2.19 

0.54 

1.02 

0.56 

10031 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10031 

C 

0 

6 

26 

-0.10 

0.62 

1.69 

-0.37 

10031 

D 

0 

3 

13 

-0.57 

0.92 

0.70 

-0.33 

10032 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

10032 

A 

1 

14 

64 

1.72 

0.42 

0.87 

0.48 

10032 

B 

0 

1 

5 

-0.26 

0.00 

0.35 

-0.20 

10032 

C 

0 

4 

18 

0.19 

0.43 

0.71 

-0.29 

10032 

D 

0 

3 

14 

0.27 

1.06 

1.27 

-0.22 

10033 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10033 

A 

1 

14 

58 

2.07 

0.42 

0.58 

0.67 

10033 

B 

0 

5 

21 

0.00 

0.17 

0.56 

-0.27 

10033 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10033 

D 

0 

5 

21 

-0.97 

0.80 

0.42 

-0.54 

10034 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10034 

A 

1 

16 

70 

1.67 

0.36 

1.01 

0.45 

10034 

B 

0 

2 

9 

-0.38 

0.02 

0.29 

-0.36 

10034 

C 

0 

3 

13 

0.38 

0.63 

0.95 

-0.24 

10034 

D 

0 

2 

9 

0.90 

0.37 

1.12 

-0.08 

10035 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10035 

A 

1 

14 

58 

2.23 

0.46 

0.80 

0.67 

10035 

B 

0 

2 

8 

-1.03 

0.23 

0.18 

-0.38 

10035 

C 

0 

5 

21 

-0.07 

0.17 

0.48 

-0.37 

10035 

D 

0 

3 

13 

0.20 

0.39 

0.68 

-0.22 



easyCBM CCSS First Grade Math Measure Development 


196 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10036 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10036 

A 

1 

11 

46 

2.34 

0.40 

0.70 

0.68 

10036 

B 

0 

2 

8 

-0.23 

1.88 

0.85 

-0.27 

10036 

C 

0 

5 

21 

0.24 

0.33 

0.52 

-0.31 

10036 

D 

0 

6 

25 

0.33 

0.41 

0.68 

-0.32 

10037 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10037 

A 

1 

14 

58 

1.94 

0.47 

1.46 

0.52 

10037 

B 

0 

1 

4 

0.31 

0.00 

0.52 

-0.11 

10037 

C 

0 

1 

4 

0.53 

0.00 

0.64 

-0.08 

10037 

D 

0 

8 

33 

0.11 

0.40 

0.60 

-0.46 

10038 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10038 

A 

1 

17 

71 

1.46 

0.43 

1.28 

0.27 

10038 

B 

0 

2 

8 

0.10 

0.30 

0.60 

-0.21 

10038 

C 

0 

2 

8 

0.87 

0.78 

1.65 

-0.06 

10038 

D 

0 

3 

13 

0.63 

0.28 

1.06 

-0.14 

10039 

* 

-1 

1254 

66 

1.65 

0.04 

0.00 

0.13 

10039 

A 

1 

430 

67 

1.91 

0.07 

0.97 

0.56 

10039 

B 

0 

72 

11 

0.12 

0.12 

0.76 

-0.26 

10039 

C 

0 

45 

7 

0.14 

0.14 

0.78 

-0.20 

10039 

D 

0 

93 

15 

-0.15 

0.13 

0.62 

-0.37 

10040 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10040 

A 

1 

17 

71 

1.27 

0.28 

1.08 

0.33 

10040 

B 

0 

1 

4 

0.78 

0.00 

0.95 

-0.04 

10040 

C 

0 

2 

8 

0.96 

0.41 

1.24 

-0.02 

10040 

D 

0 

4 

17 

0.05 

0.81 

0.79 

-0.36 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10041 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10041 

A 

1 

19 

79 

1.34 

0.36 

1.52 

0.02 

10041 

B 

0 

2 

8 

1.18 

2.73 

12.36 

-0.03 

10041 

C 

0 

3 

13 

1.31 

0.70 

2.76 

0.00 

10041 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10042 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10042 

A 

1 

17 

74 

1.66 

0.43 

0.99 

0.42 

10042 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10042 

C 

0 

2 

9 

0.03 

0.77 

0.84 

-0.21 

10042 

D 

0 

4 

17 

-0.01 

0.66 

1.05 

-0.33 

10043 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10043 

A 

1 

16 

67 

1.89 

0.45 

1.80 

0.34 

10043 

B 

0 

2 

8 

-0.08 

0.83 

0.49 

-0.26 

10043 

C 

0 

2 

8 

1.64 

1.29 

3.88 

0.03 

10043 

D 

0 

4 

17 

0.44 

0.90 

1.48 

-0.26 

10044 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10044 

A 

1 

11 

50 

2.83 

0.46 

0.56 

0.75 

10044 

B 

0 

2 

9 

-0.37 

0.41 

0.28 

-0.29 

10044 

C 

0 

3 

14 

0.58 

0.28 

0.71 

-0.16 

10044 

D 

0 

6 

27 

-0.30 

0.56 

0.52 

-0.53 

10045 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

0.00 

10045 

A 

1 

17 

81 

2.08 

0.40 

1.01 

0.52 

10045 

B 

0 

1 

5 

0.68 

0.00 

0.63 

-0.09 

10045 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10045 

D 

0 

3 

14 

-1.25 

1.99 

0.67 

-0.53 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10046 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.06 

10046 

A 

1 

8 

33 

1.48 

0.72 

3.27 

0.35 

10046 

B 

0 

4 

17 

0.24 

0.47 

0.75 

-0.14 

10046 

C 

0 

4 

17 

0.88 

0.64 

2.06 

0.05 

10046 

D 

0 

8 

33 

0.13 

0.43 

0.85 

-0.27 

10047 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10047 

A 

1 

11 

48 

2.24 

0.49 

1.18 

0.48 

10047 

B 

0 

3 

13 

-0.19 

0.92 

0.51 

-0.38 

10047 

C 

0 

2 

9 

1.31 

1.71 

2.77 

-0.02 

10047 

D 

0 

7 

30 

0.87 

0.40 

1.00 

-0.22 

10048 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10048 

A 

1 

15 

63 

1.80 

0.40 

0.77 

0.60 

10048 

B 

0 

2 

8 

-0.24 

0.15 

0.45 

-0.24 

10048 

C 

0 

5 

21 

-0.06 

0.50 

0.99 

-0.36 

10048 

D 

0 

2 

8 

-0.39 

0.55 

0.44 

-0.27 

10049 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10049 

A 

1 

13 

57 

1.85 

0.45 

0.79 

0.61 

10049 

B 

0 

2 

9 

-0.91 

0.16 

0.21 

-0.37 

10049 

C 

0 

6 

26 

-0.03 

0.28 

0.58 

-0.38 

10049 

D 

0 

2 

9 

0.38 

0.92 

1.10 

-0.12 

10050 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10050 

A 

1 

5 

21 

2.45 

0.57 

0.58 

0.56 

10050 

B 

0 

10 

42 

0.73 

0.25 

0.63 

-0.18 

10050 

C 

0 

6 

25 

0.91 

0.65 

1.47 

-0.05 

10050 

D 

0 

3 

13 

-0.19 

0.45 

0.25 

-0.35 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10051 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10051 

A 

1 

17 

74 

1.70 

0.38 

0.79 

0.56 

10051 

B 

0 

2 

9 

-0.11 

0.76 

0.67 

-0.22 

10051 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10051 

D 

0 

4 

17 

-0.67 

0.72 

0.49 

-0.48 

10052 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10052 

A 

1 

15 

63 

1.69 

0.48 

1.19 

0.37 

10052 

B 

0 

3 

13 

0.76 

0.85 

2.07 

-0.11 

10052 

C 

0 

4 

17 

0.47 

0.28 

0.84 

-0.21 

10052 

D 

0 

2 

8 

0.02 

0.03 

0.47 

-0.23 

10053 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

0.00 

10053 

A 

1 

12 

52 

2.76 

0.54 

0.73 

0.67 

10053 

B 

0 

2 

9 

0.54 

0.01 

0.63 

-0.17 

10053 

C 

0 

6 

26 

0.49 

0.37 

0.84 

-0.34 

10053 

D 

0 

3 

13 

-0.45 

0.24 

0.25 

-0.41 

10054 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10054 

A 

1 

12 

50 

1.98 

0.48 

1.07 

0.43 

10054 

B 

0 

3 

13 

0.73 

0.41 

0.84 

-0.15 

10054 

C 

0 

2 

8 

0.15 

0.50 

0.46 

-0.24 

10054 

D 

0 

7 

29 

0.84 

0.54 

1.95 

-0.21 

10055 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.04 

10055 

A 

1 

7 

30 

4.39 

0.34 

0.21 

0.85 

10055 

B 

0 

7 

30 

1.16 

0.40 

0.66 

-0.34 

10055 

C 

0 

3 

13 

0.44 

0.90 

0.35 

-0.35 

10055 

D 

0 

6 

26 

1.28 

0.26 

0.51 

-0.26 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10056 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10056 

A 

1 

7 

30 

1.97 

0.59 

1.84 

0.47 

10056 

B 

0 

4 

17 

-0.36 

0.57 

0.34 

-0.45 

10056 

C 

0 

4 

17 

0.80 

0.31 

0.70 

-0.07 

10056 

D 

0 

8 

35 

0.91 

0.43 

1.59 

-0.04 

10057 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10057 

A 

1 

17 

74 

1.47 

0.29 

0.69 

0.61 

10057 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10057 

C 

0 

4 

17 

-0.10 

0.26 

0.55 

-0.37 

10057 

D 

0 

2 

9 

-0.97 

0.80 

0.28 

-0.45 

10058 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10058 

A 

1 

16 

67 

1.53 

0.46 

1.24 

0.31 

10058 

B 

0 

2 

8 

0.58 

0.22 

1.02 

-0.11 

10058 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10058 

D 

0 

6 

25 

0.39 

0.57 

2.16 

-0.27 

10059 

* 

-1 

1716 

91 

1.51 

0.03 

0.00 

-0.04 

10059 

A 

1 

150 

84 

1.94 

0.10 

0.93 

0.42 

10059 

B 

0 

13 

7 

-0.19 

0.32 

0.40 

-0.39 

10059 

C 

0 

14 

8 

0.99 

0.24 

1.16 

-0.15 

10059 

D 

0 

1 

1 

-0.77 

0.00 

0.14 

-0.14 

10060 

* 

-1 

1717 

91 

1.51 

0.03 

0.00 

-0.02 

10060 

A 

1 

148 

84 

1.91 

0.09 

0.89 

0.50 

10060 

B 

0 

13 

7 

0.38 

0.29 

0.79 

-0.28 

10060 

C 

0 

13 

7 

0.10 

0.24 

0.45 

-0.34 

10060 

D 

0 

3 

2 

-0.11 

0.99 

0.54 

-0.18 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10061 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10061 

A 

1 

14 

61 

1.43 

0.32 

1.04 

0.44 

10061 

B 

0 

2 

9 

1.48 

0.10 

1.88 

0.12 

10061 

C 

0 

2 

9 

-0.05 

0.96 

0.60 

-0.28 

10061 

D 

0 

5 

22 

0.07 

0.30 

0.55 

-0.42 

10062 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10062 

A 

1 

17 

71 

1.81 

0.46 

1.07 

0.47 

10062 

B 

0 

1 

4 

-0.95 

0.00 

0.23 

-0.26 

10062 

C 

0 

6 

25 

0.13 

0.18 

0.75 

-0.37 

10062 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10063 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.00 

10063 

A 

1 

19 

86 

1.78 

0.48 

1.03 

0.34 

10063 

B 

0 

3 

14 

-0.21 

0.35 

0.71 

-0.34 

10063 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10063 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10064 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

10064 

A 

1 

16 

73 

1.81 

0.38 

0.71 

0.56 

10064 

B 

0 

2 

9 

0.33 

0.62 

0.83 

-0.18 

10064 

C 

0 

1 

5 

-0.58 

0.00 

0.28 

-0.25 

10064 

D 

0 

3 

14 

-0.44 

0.65 

0.45 

-0.42 

10065 

* 

-1 

1725 

91 

1.55 

0.03 

0.00 

0.06 

10065 

A 

1 

153 

91 

1.39 

0.09 

0.88 

0.37 

10065 

B 

0 

5 

3 

-0.05 

0.64 

1.02 

-0.18 

10065 

C 

0 

10 

6 

-0.35 

0.37 

0.66 

-0.32 

10065 

D 

0 

1 

1 

0.96 

0.00 

1.31 

-0.02 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10066 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10066 

A 

1 

15 

63 

1.56 

0.38 

1.16 

0.51 

10066 

B 

0 

6 

25 

0.45 

0.44 

1.10 

-0.10 

10066 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10066 

D 

0 

3 

13 

-2.36 

1.57 

0.32 

-0.62 

10067 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10067 

A 

1 

8 

33 

1.75 

0.30 

0.84 

0.42 

10067 

B 

0 

8 

33 

1.42 

0.42 

2.13 

0.24 

10067 

C 

0 

4 

17 

0.02 

0.54 

0.43 

-0.32 

10067 

D 

0 

4 

17 

-0.56 

0.64 

0.25 

-0.51 

10068 

* 

-1 

1713 

90 

1.52 

0.03 

0.00 

-0.02 

10068 

A 

1 

73 

40 

2.39 

0.13 

0.84 

0.57 

10068 

B 

0 

92 

51 

1.16 

0.08 

0.84 

-0.40 

10068 

C 

0 

15 

8 

0.74 

0.23 

0.58 

-0.23 

10068 

D 

0 

1 

1 

-1.77 

0.00 

0.03 

-0.22 

10069 

* 

-1 

1722 

91 

1.50 

0.03 

0.00 

-0.05 

10069 

A 

1 

148 

86 

1.99 

0.11 

0.87 

0.43 

10069 

B 

0 

6 

3 

1.00 

0.59 

1.74 

-0.10 

10069 

C 

0 

15 

9 

0.09 

0.24 

0.53 

-0.37 

10069 

D 

0 

3 

2 

-0.56 

0.73 

0.31 

-0.22 

10070 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10070 

A 

1 

12 

50 

2.96 

0.58 

1.79 

0.59 

10070 

B 

0 

1 

4 

-0.35 

0.00 

0.15 

-0.16 

10070 

C 

0 

9 

38 

0.97 

0.35 

0.91 

-0.17 

10070 

D 

0 

2 

8 

-3.86 

1.37 

0.02 

-0.66 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10071 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10071 

A 

1 

17 

77 

1.73 

0.43 

1.18 

0.38 

10071 

B 

0 

1 

5 

-0.20 

0.00 

0.41 

-0.21 

10071 

C 

0 

4 

18 

0.36 

0.40 

0.87 

-0.30 

10071 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10072 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10072 

A 

1 

9 

39 

1.92 

0.77 

2.59 

0.41 

10072 

B 

0 

8 

35 

0.77 

0.22 

0.96 

-0.16 

10072 

C 

0 

1 

4 

-0.16 

0.00 

0.32 

-0.17 

10072 

D 

0 

5 

22 

0.45 

0.24 

0.66 

-0.22 

10073 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10073 

A 

1 

19 

83 

2.08 

0.37 

0.74 

0.54 

10073 

B 

0 

3 

13 

-0.60 

0.25 

0.28 

-0.50 

10073 

C 

0 

1 

4 

0.19 

0.00 

0.58 

-0.18 

10073 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10074 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

10074 

A 

1 

14 

64 

1.78 

0.28 

0.96 

0.55 

10074 

B 

0 

4 

18 

1.08 

0.51 

1.33 

-0.08 

10074 

C 

0 

1 

5 

0.26 

0.00 

0.42 

-0.19 

10074 

D 

0 

3 

14 

-0.40 

0.28 

0.23 

-0.57 

10075 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10075 

A 

1 

22 

92 

1.80 

0.37 

1.07 

0.17 

10075 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10075 

C 

0 

2 

8 

0.78 

0.48 

1.06 

-0.17 

10075 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10076 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.01 

10076 

A 

1 

20 

80 

1.89 

0.32 

0.79 

0.53 

10076 

B 

0 

3 

12 

0.46 

0.90 

1.56 

-0.23 

10076 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10076 

D 

0 

2 

8 

-1.31 

0.39 

0.13 

-0.51 

10077 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.04 

10077 

A 

1 

20 

83 

2.59 

0.32 

0.48 

0.71 

10077 

B 

0 

1 

4 

-0.25 

0.00 

0.31 

-0.25 

10077 

C 

0 

1 

4 

-0.20 

0.00 

0.32 

-0.24 

10077 

D 

0 

2 

8 

-1.79 

0.90 

0.09 

-0.60 

10078 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10078 

A 

1 

21 

91 

1.63 

0.31 

0.62 

0.41 

10078 

B 

0 

1 

4 

1.97 

0.00 

5.17 

0.07 

10078 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10078 

D 

0 

1 

4 

-3.76 

0.00 

0.02 

-0.64 

10079 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10079 

A 

1 

20 

83 

1.67 

0.38 

1.13 

0.30 

10079 

B 

0 

2 

8 

1.24 

0.20 

1.81 

-0.04 

10079 

C 

0 

2 

8 

-0.57 

0.39 

0.32 

-0.37 

10079 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10080 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.02 

10080 

A 

-1 

20 

100 

1.20 

0.37 

0.00 

0.00 

10080 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10080 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10080 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10081 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10081 

A 

1 

21 

88 

1.31 

0.30 

1.24 

0.29 

10081 

B 

0 

1 

4 

1.32 

0.00 

2.21 

0.02 

10081 

C 

0 

1 

4 

-0.91 

0.00 

0.24 

-0.32 

10081 

D 

0 

1 

4 

-0.08 

0.00 

0.55 

-0.19 

10082 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10082 

A 

1 

21 

91 

1.14 

0.27 

0.88 

0.43 

10082 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10082 

C 

0 

1 

4 

0.31 

0.00 

1.05 

-0.11 

10082 

D 

0 

1 

4 

-2.04 

0.00 

0.10 

-0.49 

10083 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10083 

A 

1 

21 

88 

1.41 

0.36 

1.10 

0.21 

10083 

B 

0 

1 

4 

1.65 

0.00 

2.95 

0.05 

10083 

C 

0 

2 

8 

-0.21 

0.25 

0.47 

-0.29 

10083 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10084 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10084 

A 

1 

22 

92 

1.69 

0.30 

1.01 

0.23 

10084 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10084 

C 

0 

2 

8 

0.56 

0.73 

0.87 

-0.23 

10084 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10085 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.02 

10085 

A 

1 

9 

36 

2.46 

0.47 

0.83 

0.61 

10085 

B 

0 

4 

16 

0.73 

0.67 

1.01 

-0.18 

10085 

C 

0 

7 

28 

1.19 

0.30 

1.02 

-0.05 

10085 

D 

0 

5 

20 

-0.11 

0.32 

0.28 

-0.50 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10086 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10086 

A 

1 

10 

43 

1.61 

0.40 

1.18 

0.30 

10086 

B 

0 

7 

30 

0.66 

0.21 

0.62 

-0.32 

10086 

C 

0 

3 

13 

1.29 

0.83 

1.73 

0.02 

10086 

D 

0 

3 

13 

1.11 

1.02 

1.64 

-0.03 

10087 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10087 

A 

1 

15 

63 

2.03 

0.30 

0.78 

0.58 

10087 

B 

0 

5 

21 

0.87 

0.65 

1.48 

-0.10 

10087 

C 

0 

2 

8 

-0.62 

1.72 

0.50 

-0.31 

10087 

D 

0 

2 

8 

-2.19 

1.58 

0.09 

-0.56 

10088 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10088 

A 

1 

18 

75 

1.44 

0.36 

1.09 

0.33 

10088 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10088 

C 

0 

3 

13 

1.07 

1.11 

5.16 

-0.02 

10088 

D 

0 

3 

13 

-0.55 

0.26 

0.36 

-0.41 

10089 

* 

-1 

1869 

99 

1.52 

0.03 

0.00 

-0.01 

10089 

A 

1 

23 

92 

1.84 

0.37 

0.95 

0.38 

10089 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10089 

C 

0 

1 

4 

-0.94 

0.00 

0.24 

-0.29 

10089 

D 

0 

1 

4 

-0.54 

0.00 

0.36 

-0.24 

10090 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

10090 

A 

1 

15 

65 

2.29 

0.24 

0.87 

0.52 

10090 

B 

0 

7 

30 

1.01 

0.55 

1.57 

-0.45 

10090 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10090 

D 

0 

1 

4 

0.65 

0.00 

0.38 

-0.21 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10091 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.01 

10091 

A 

1 

15 

68 

2.20 

0.29 

0.66 

0.69 

10091 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10091 

C 

0 

5 

23 

0.48 

0.21 

0.50 

-0.47 

10091 

D 

0 

2 

9 

-0.13 

0.41 

0.27 

-0.42 

10092 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10092 

A 

1 

16 

70 

1.52 

0.34 

1.08 

0.25 

10092 

B 

0 

2 

9 

0.08 

0.43 

0.45 

-0.30 

10092 

C 

0 

3 

13 

0.85 

0.90 

1.69 

-0.14 

10092 

D 

0 

2 

9 

1.52 

0.64 

2.12 

0.05 

10093 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.04 

10093 

A 

1 

11 

44 

2.15 

0.58 

1.47 

0.48 

10093 

B 

0 

3 

12 

1.11 

0.99 

2.21 

0.01 

10093 

C 

0 

11 

44 

-0.10 

0.58 

0.67 

-0.48 

10093 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10094 

* 

-1 

1254 

66 

1.65 

0.04 

0.00 

0.13 

10094 

A 

1 

341 

53 

2.04 

0.08 

1.10 

0.51 

10094 

B 

0 

109 

17 

0.72 

0.12 

1.38 

-0.16 

10094 

C 

0 

110 

17 

0.52 

0.10 

1.07 

-0.22 

10094 

D 

0 

80 

13 

-0.16 

0.15 

0.57 

-0.34 

10095 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.04 

10095 

A 

1 

19 

86 

2.47 

0.32 

0.65 

0.63 

10095 

B 

0 

1 

5 

-0.21 

0.00 

0.27 

-0.31 

10095 

C 

0 

1 

5 

-0.66 

0.00 

0.17 

-0.37 

10095 

D 

0 

1 

5 

-0.47 

0.00 

0.21 

-0.35 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10096 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10096 

A 

1 

18 

75 

1.52 

0.37 

0.70 

0.58 

10096 

B 

0 

1 

4 

-0.59 

0.00 

0.43 

-0.17 

10096 

C 

0 

2 

8 

-1.36 

0.42 

0.22 

-0.37 

10096 

D 

0 

3 

13 

-0.80 

1.32 

1.15 

-0.35 

10097 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10097 

A 

1 

17 

71 

1.89 

0.35 

1.05 

0.51 

10097 

B 

0 

4 

17 

0.18 

0.46 

0.63 

-0.38 

10097 

C 

0 

3 

13 

0.34 

0.49 

0.69 

-0.28 

10097 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10098 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.05 

10098 

A 

1 

16 

70 

1.43 

0.33 

0.87 

0.56 

10098 

B 

0 

3 

13 

0.05 

0.90 

1.36 

-0.24 

10098 

C 

0 

1 

4 

0.01 

0.00 

0.59 

-0.14 

10098 

D 

0 

3 

13 

-0.70 

0.23 

0.31 

-0.44 

10099 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10099 

A 

1 

21 

88 

1.51 

0.29 

0.86 

0.43 

10099 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10099 

C 

0 

2 

8 

-0.55 

0.10 

0.27 

-0.41 

10099 

D 

0 

1 

4 

0.35 

0.00 

0.66 

-0.15 

10100 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10100 

A 

1 

15 

68 

2.11 

0.44 

0.82 

0.54 

10100 

B 

0 

2 

9 

-1.67 

0.73 

0.11 

-0.50 

10100 

C 

0 

3 

14 

-0.47 

0.68 

0.41 

-0.38 

10100 

D 

0 

2 

9 

1.85 

0.82 

3.91 

0.07 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10101 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10101 

A 

1 

17 

71 

1.86 

0.31 

0.68 

0.60 

10101 

B 

0 

3 

13 

-0.27 

0.10 

0.33 

-0.40 

10101 

C 

0 

2 

8 

0.86 

1.20 

1.81 

-0.09 

10101 

D 

0 

2 

8 

-0.74 

0.85 

0.28 

-0.42 

10102 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.05 

10102 

A 

1 

17 

71 

2.62 

0.35 

1.14 

0.44 

10102 

B 

0 

5 

21 

1.90 

0.34 

1.60 

-0.09 

10102 

C 

0 

1 

4 

-0.95 

0.00 

0.07 

-0.42 

10102 

D 

0 

1 

4 

-0.85 

0.00 

0.08 

-0.40 

10103 

* 

-1 

1701 

90 

1.54 

0.03 

0.00 

0.04 

10103 

A 

1 

151 

78 

1.59 

0.09 

1.00 

0.35 

10103 

B 

0 

20 

10 

0.39 

0.17 

0.71 

-0.29 

10103 

C 

0 

22 

11 

0.82 

0.23 

1.40 

-0.17 

10103 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10104 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10104 

A 

1 

14 

58 

1.34 

0.31 

1.14 

0.44 

10104 

B 

0 

5 

21 

0.50 

0.28 

0.82 

-0.17 

10104 

C 

0 

2 

8 

1.34 

0.41 

1.82 

0.11 

10104 

D 

0 

3 

13 

-0.84 

0.64 

0.29 

-0.54 

10105 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10105 

A 

1 

16 

67 

2.00 

0.37 

0.85 

0.60 

10105 

B 

0 

2 

8 

-0.33 

0.93 

0.43 

-0.22 

10105 

C 

0 

3 

13 

0.27 

0.38 

0.61 

-0.17 

10105 

D 

0 

3 

13 

-1.54 

1.85 

0.58 

-0.51 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10106 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10106 

A 

1 

20 

83 

2.07 

0.31 

0.62 

0.65 

10106 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10106 

C 

0 

2 

8 

-0.66 

0.55 

0.27 

-0.41 

10106 

D 

0 

2 

8 

-0.94 

0.28 

0.18 

-0.46 

10107 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10107 

A 

1 

17 

71 

2.36 

0.35 

0.67 

0.68 

10107 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10107 

C 

0 

5 

21 

-0.20 

0.30 

0.35 

-0.56 

10107 

D 

0 

2 

8 

-0.04 

0.22 

0.35 

-0.30 

10108 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

10108 

A 

1 

16 

73 

1.86 

0.28 

0.63 

0.67 

10108 

B 

0 

2 

9 

0.34 

0.91 

0.84 

-0.19 

10108 

C 

0 

2 

9 

-0.54 

1.57 

0.60 

-0.38 

10108 

D 

0 

2 

9 

-0.90 

0.11 

0.17 

-0.46 

10109 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.01 

10109 

A 

1 

19 

86 

1.83 

0.34 

1.20 

0.22 

10109 

B 

0 

1 

5 

1.31 

0.00 

1.26 

-0.06 

10109 

C 

0 

1 

5 

0.07 

0.00 

0.36 

-0.26 

10109 

D 

0 

1 

5 

1.47 

0.00 

1.47 

-0.04 

10110 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10110 

A 

1 

17 

71 

1.24 

0.36 

1.03 

0.32 

10110 

B 

0 

5 

21 

0.82 

0.33 

1.59 

-0.04 

10110 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10110 

D 

0 

2 

8 

-1.33 

1.07 

0.24 

-0.46 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10111 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10111 

A 

1 

18 

78 

1.66 

0.37 

0.60 

0.65 

10111 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10111 

C 

0 

3 

13 

-1.14 

0.58 

0.35 

-0.46 

10111 

D 

0 

2 

9 

-1.32 

0.38 

0.22 

-0.40 

10112 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10112 

A 

1 

10 

43 

2.40 

0.31 

0.53 

0.75 

10112 

B 

0 

4 

17 

0.23 

0.48 

0.46 

-0.37 

10112 

C 

0 

9 

39 

0.51 

0.26 

0.62 

-0.48 

10112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10113 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10113 

A 

1 

16 

67 

1.87 

0.37 

0.86 

0.58 

10113 

B 

0 

3 

13 

-0.30 

0.33 

0.40 

-0.38 

10113 

C 

0 

1 

4 

-0.54 

0.00 

0.28 

-0.24 

10113 

D 

0 

4 

17 

0.34 

0.44 

0.96 

-0.27 

10114 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

10114 

A 

1 

15 

65 

1.01 

0.30 

1.20 

0.23 

10114 

B 

0 

3 

13 

-0.10 

0.32 

0.53 

-0.32 

10114 

C 

0 

3 

13 

0.43 

0.69 

1.36 

-0.13 

10114 

D 

0 

2 

9 

1.40 

1.13 

3.69 

0.16 

10115 

* 

-1 

1874 

99 

1.54 

0.03 

0.00 

0.09 

10115 

A 

1 

12 

60 

0.87 

0.35 

0.95 

0.48 

10115 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10115 

C 

0 

6 

30 

0.07 

0.33 

1.06 

-0.16 

10115 

D 

0 

2 

10 

-1.66 

0.74 

0.19 

-0.54 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10116 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10116 

A 

1 

17 

71 

1.67 

0.34 

0.96 

0.52 

10116 

B 

0 

1 

4 

-0.82 

0.00 

0.21 

-0.29 

10116 

C 

0 

5 

21 

0.29 

0.36 

0.79 

-0.32 

10116 

D 

0 

1 

4 

-0.47 

0.00 

0.29 

-0.24 

10117 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10117 

A 

1 

12 

50 

2.04 

0.40 

1.05 

0.44 

10117 

B 

0 

4 

17 

1.20 

0.45 

1.20 

-0.10 

10117 

C 

0 

5 

21 

1.19 

0.39 

1.08 

-0.12 

10117 

D 

0 

3 

13 

0.11 

0.53 

0.38 

-0.41 

10118 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.07 

10118 

A 

1 

15 

63 

1.21 

0.35 

0.99 

0.38 

10118 

B 

0 

3 

13 

1.13 

1.57 

10.46 

0.09 

10118 

C 

0 

4 

17 

-0.20 

0.59 

0.82 

-0.23 

10118 

D 

0 

2 

8 

-1.94 

1.83 

0.29 

-0.46 

10119 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10119 

A 

1 

5 

22 

4.48 

0.54 

0.23 

0.75 

10119 

B 

0 

6 

26 

0.26 

0.74 

0.90 

-0.40 

10119 

C 

0 

8 

35 

1.38 

0.46 

0.86 

-0.08 

10119 

D 

0 

4 

17 

0.48 

0.38 

0.26 

-0.26 

10120 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10120 

A 

1 

13 

59 

1.28 

0.34 

1.16 

0.36 

10120 

B 

0 

2 

9 

1.09 

0.55 

1.58 

0.05 

10120 

C 

0 

7 

32 

0.17 

0.47 

1.16 

-0.41 

10120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10121 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10121 

A 

1 

11 

48 

2.14 

0.49 

1.61 

0.61 

10121 

B 

0 

2 

9 

0.00 

0.03 

0.34 

-0.22 

10121 

C 

0 

7 

30 

0.50 

0.35 

0.79 

-0.26 

10121 

D 

0 

3 

13 

-0.41 

0.75 

0.37 

-0.37 

10122 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10122 

A 

1 

12 

50 

1.72 

0.42 

0.87 

0.54 

10122 

B 

0 

5 

21 

-1.17 

0.44 

0.19 

-0.65 

10122 

C 

0 

2 

8 

0.69 

0.22 

0.90 

-0.03 

10122 

D 

0 

5 

21 

0.88 

0.46 

1.59 

0.01 

10123 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10123 

A 

1 

13 

54 

1.96 

0.37 

1.10 

0.57 

10123 

B 

0 

4 

17 

0.68 

0.22 

0.63 

-0.22 

10123 

C 

0 

5 

21 

0.56 

0.22 

0.57 

-0.31 

10123 

D 

0 

2 

8 

0.18 

1.11 

0.60 

-0.27 

10124 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.00 

10124 

A 

1 

18 

82 

1.79 

0.28 

0.96 

0.48 

10124 

B 

0 

2 

9 

0.65 

0.27 

0.66 

-0.22 

10124 

C 

0 

2 

9 

-0.11 

0.47 

0.33 

-0.42 

10124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10125 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10125 

A 

1 

15 

63 

1.75 

0.30 

0.86 

0.49 

10125 

B 

0 

6 

25 

0.06 

0.40 

0.63 

-0.50 

10125 

C 

0 

2 

8 

1.82 

1.17 

4.12 

0.13 

10125 

D 

0 

1 

4 

-0.65 

0.00 

0.20 

-0.29 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10126 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10126 

A 

1 

14 

61 

2.25 

0.45 

0.76 

0.59 

10126 

B 

0 

2 

9 

0.43 

0.12 

0.58 

-0.17 

10126 

C 

0 

5 

22 

0.27 

0.51 

0.81 

-0.34 

10126 

D 

0 

2 

9 

-0.62 

0.96 

0.30 

-0.36 

10127 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

10127 

A 

1 

15 

68 

1.34 

0.32 

1.33 

0.26 

10127 

B 

0 

3 

14 

0.43 

0.68 

0.96 

-0.25 

10127 

C 

0 

2 

9 

1.77 

0.24 

2.39 

0.17 

10127 

D 

0 

2 

9 

0.04 

0.22 

0.43 

-0.30 

10128 

* 

-1 

1724 

91 

1.52 

0.03 

0.00 

-0.01 

10128 

A 

1 

92 

54 

2.05 

0.11 

1.00 

0.45 

10128 

B 

0 

40 

24 

1.14 

0.15 

0.98 

-0.20 

10128 

C 

0 

35 

21 

0.91 

0.17 

0.92 

-0.29 

10128 

D 

0 

3 

2 

0.36 

0.73 

0.53 

-0.14 

10129 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10129 

A 

1 

13 

54 

1.50 

0.37 

1.02 

0.51 

10129 

B 

0 

4 

17 

-0.31 

0.36 

0.41 

-0.41 

10129 

C 

0 

5 

21 

0.40 

0.43 

0.94 

-0.19 

10129 

D 

0 

2 

8 

0.46 

1.12 

1.23 

-0.10 

10130 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10130 

A 

1 

11 

50 

2.10 

0.32 

0.47 

0.76 

10130 

B 

0 

2 

9 

0.58 

0.78 

1.09 

-0.05 

10130 

C 

0 

5 

23 

-0.54 

0.30 

0.32 

-0.45 

10130 

D 

0 

4 

18 

-0.74 

0.84 

0.40 

-0.45 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10131 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10131 

A 

1 

11 

48 

1.48 

0.54 

1.82 

0.26 

10131 

B 

0 

4 

17 

0.99 

0.51 

1.43 

-0.04 

10131 

C 

0 

2 

9 

0.00 

0.03 

0.39 

-0.24 

10131 

D 

0 

6 

26 

0.83 

0.43 

1.30 

-0.11 

10132 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10132 

A 

1 

10 

42 

1.28 

0.57 

1.52 

0.31 

10132 

B 

0 

6 

25 

0.55 

0.41 

1.42 

-0.09 

10132 

C 

0 

3 

13 

-0.49 

0.62 

0.42 

-0.34 

10132 

D 

0 

5 

21 

0.74 

0.36 

1.35 

-0.01 

10133 

* 

-1 

1692 

89 

1.51 

0.03 

0.00 

-0.04 

10133 

A 

1 

146 

72 

2.00 

0.10 

1.14 

0.43 

10133 

B 

0 

12 

6 

0.62 

0.18 

0.56 

-0.21 

10133 

C 

0 

38 

19 

0.93 

0.15 

1.03 

-0.29 

10133 

D 

0 

6 

3 

0.40 

0.69 

1.70 

-0.18 

10134 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

10134 

A 

1 

15 

68 

1.77 

0.43 

0.97 

0.49 

10134 

B 

0 

5 

23 

-0.17 

0.54 

0.85 

-0.45 

10134 

C 

0 

1 

5 

-0.26 

0.00 

0.39 

-0.19 

10134 

D 

0 

1 

5 

1.22 

0.00 

1.71 

0.00 

10135 

* 

-1 

1705 

90 

1.52 

0.03 

0.00 

-0.02 

10135 

A 

1 

119 

63 

2.09 

0.11 

0.88 

0.49 

10135 

B 

0 

34 

18 

0.97 

0.17 

1.02 

-0.22 

10135 

C 

0 

28 

15 

0.81 

0.19 

0.93 

-0.25 

10135 

D 

0 

8 

4 

-0.44 

0.28 

0.22 

-0.32 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10136 

* 

-1 

1726 

91 

1.50 

0.03 

0.00 

-0.05 

10136 

A 

1 

96 

57 

2.26 

0.13 

1.11 

0.47 

10136 

B 

0 

42 

25 

1.17 

0.11 

0.83 

-0.26 

10136 

C 

0 

23 

14 

1.02 

0.20 

0.85 

-0.23 

10136 

D 

0 

7 

4 

0.47 

0.69 

0.90 

-0.21 

10137 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10137 

A 

1 

12 

52 

2.19 

0.41 

0.87 

0.54 

10137 

B 

0 

3 

13 

0.62 

0.80 

1.05 

-0.20 

10137 

C 

0 

6 

26 

0.24 

0.54 

0.70 

-0.46 

10137 

D 

0 

2 

9 

1.39 

0.31 

1.22 

0.00 

10138 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10138 

A 

1 

15 

65 

2.01 

0.44 

0.67 

0.63 

10138 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10138 

C 

0 

4 

17 

-0.56 

0.44 

0.42 

-0.38 

10138 

D 

0 

4 

17 

-0.74 

1.03 

0.60 

-0.42 

10139 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10139 

A 

1 

19 

79 

2.02 

0.34 

0.73 

0.57 

10139 

B 

0 

3 

13 

-0.09 

0.83 

0.76 

-0.36 

10139 

C 

0 

2 

8 

-0.74 

0.08 

0.22 

-0.41 

10139 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10140 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10140 

A 

1 

11 

46 

2.27 

0.37 

0.54 

0.63 

10140 

B 

0 

8 

33 

0.32 

0.31 

0.69 

-0.24 

10140 

C 

0 

3 

13 

-0.21 

0.40 

0.32 

-0.23 

10140 

D 

0 

2 

8 

-1.87 

3.36 

1.48 

-0.45 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10141 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

10141 

A 

1 

15 

65 

2.29 

0.36 

0.63 

0.69 

10141 

B 

0 

4 

17 

-0.01 

0.62 

0.71 

-0.41 

10141 

C 

0 

2 

9 

0.09 

0.08 

0.42 

-0.26 

10141 

D 

0 

2 

9 

-0.39 

0.45 

0.29 

-0.35 

10142 

* 

-1 

1721 

91 

1.50 

0.03 

0.00 

-0.05 

10142 

A 

1 

134 

77 

2.08 

0.10 

1.03 

0.48 

10142 

B 

0 

18 

10 

0.64 

0.18 

0.61 

-0.31 

10142 

C 

0 

20 

12 

0.70 

0.22 

0.75 

-0.31 

10142 

D 

0 

1 

1 

0.30 

0.00 

0.33 

-0.09 

10143 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10143 

A 

1 

18 

78 

2.01 

0.39 

0.89 

0.49 

10143 

B 

0 

4 

17 

-0.05 

0.07 

0.40 

-0.46 

10143 

C 

0 

1 

4 

0.60 

0.00 

0.76 

-0.13 

10143 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10144 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10144 

A 

-1 

23 

100 

1.06 

0.26 

0.00 

0.00 

10144 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10144 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10144 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10145 

* 

-1 

1793 

95 

1.53 

0.03 

0.00 

0.02 

10145 

A 

1 

89 

88 

1.64 

0.13 

0.98 

0.40 

10145 

B 

0 

6 

6 

0.87 

0.42 

1.31 

-0.10 

10145 

C 

0 

4 

4 

-1.23 

1.42 

0.68 

-0.38 

10145 

D 

0 

2 

2 

-0.86 

0.91 

0.24 

-0.23 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10146 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10146 

A 

1 

20 

91 

1.65 

0.30 

0.85 

0.49 

10146 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10146 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10146 

D 

0 

2 

9 

-0.86 

0.35 

0.23 

-0.49 

10147 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.03 

10147 

A 

1 

24 

96 

1.20 

0.21 

0.88 

0.40 

10147 

B 

0 

1 

4 

-1.00 

0.00 

0.20 

-0.40 

10147 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10147 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10148 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.02 

10148 

A 

1 

16 

80 

1.64 

0.39 

0.99 

0.42 

10148 

B 

0 

1 

5 

0.34 

0.00 

0.69 

-0.15 

10148 

C 

0 

2 

10 

-0.05 

0.68 

0.57 

-0.30 

10148 

D 

0 

1 

5 

-0.08 

0.00 

0.45 

-0.21 

10149 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10149 

A 

1 

18 

75 

2.08 

0.39 

0.98 

0.55 

10149 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10149 

C 

0 

5 

21 

-0.14 

0.18 

0.42 

-0.51 

10149 

D 

0 

1 

4 

0.13 

0.00 

0.52 

-0.17 

10150 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.02 

10150 

A 

1 

10 

59 

1.67 

0.44 

1.04 

0.47 

10150 

B 

0 

4 

24 

0.76 

0.54 

1.20 

-0.18 

10150 

C 

0 

2 

12 

0.00 

0.27 

0.39 

-0.33 

10150 

D 

0 

1 

6 

0.09 

0.00 

0.41 

-0.21 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10151 

* 

-1 

1724 

91 

1.52 

0.03 

0.00 

-0.01 

10151 

A 

1 

62 

36 

2.24 

0.18 

2.11 

0.40 

10151 

B 

0 

30 

18 

1.01 

0.17 

0.81 

-0.21 

10151 

C 

0 

71 

42 

1.32 

0.11 

0.98 

-0.17 

10151 

D 

0 

7 

4 

0.77 

0.61 

0.85 

-0.13 

10152 

* 

-1 

1723 

91 

1.51 

0.03 

0.00 

-0.04 

10152 

A 

1 

93 

54 

2.05 

0.13 

1.40 

0.29 

10152 

B 

0 

60 

35 

1.41 

0.14 

1.36 

-0.19 

10152 

C 

0 

15 

9 

1.13 

0.28 

1.09 

-0.15 

10152 

D 

0 

3 

2 

0.68 

0.39 

0.45 

-0.11 

10153 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10153 

A 

1 

8 

33 

2.40 

0.82 

2.04 

0.41 

10153 

B 

0 

6 

25 

0.73 

0.62 

2.05 

-0.20 

10153 

C 

0 

1 

4 

0.33 

0.00 

0.46 

-0.12 

10153 

D 

0 

9 

38 

0.94 

0.46 

3.21 

-0.18 

10154 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10154 

A 

1 

10 

42 

1.87 

0.61 

2.53 

0.23 

10154 

B 

0 

1 

4 

0.46 

0.00 

0.35 

-0.07 

10154 

C 

0 

3 

13 

1.69 

1.25 

3.81 

0.07 

10154 

D 

0 

10 

42 

0.51 

0.95 

2.88 

-0.25 

10155 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10155 

A 

1 

10 

42 

2.37 

0.40 

0.43 

0.73 

10155 

B 

0 

4 

17 

0.53 

0.21 

0.71 

-0.10 

10155 

C 

0 

2 

8 

-0.13 

0.14 

0.35 

-0.18 

10155 

D 

0 

8 

33 

-0.49 

0.52 

0.54 

-0.58 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10156 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

10156 

A 

1 

9 

39 

2.31 

0.78 

2.22 

0.34 

10156 

B 

0 

7 

30 

1.20 

0.52 

1.74 

-0.11 

10156 

C 

0 

3 

13 

-0.09 

0.83 

0.51 

-0.33 

10156 

D 

0 

4 

17 

1.40 

0.83 

2.32 

-0.02 

10157 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10157 

A 

1 

11 

46 

1.52 

0.44 

2.53 

0.15 

10157 

B 

0 

3 

13 

1.47 

0.60 

1.57 

0.04 

10157 

C 

0 

3 

13 

0.58 

0.59 

0.63 

-0.25 

10157 

D 

0 

7 

29 

1.31 

0.35 

1.35 

-0.02 

10158 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10158 

A 

1 

8 

33 

2.12 

0.72 

1.98 

0.38 

10158 

B 

0 

11 

46 

0.94 

0.26 

0.89 

-0.24 

10158 

C 

0 

2 

8 

-0.13 

0.82 

0.30 

-0.30 

10158 

D 

0 

3 

13 

1.57 

0.81 

1.91 

0.06 

10159 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10159 

A 

1 

13 

54 

2.62 

0.32 

0.67 

0.59 

10159 

B 

0 

5 

21 

0.20 

0.48 

0.40 

-0.31 

10159 

C 

0 

5 

21 

1.15 

0.87 

2.27 

-0.08 

10159 

D 

0 

1 

4 

-5.24 

0.00 

0.00 

-0.67 

10160 

* 

-1 

1867 

99 

1.54 

0.03 

0.00 

0.06 

10160 

A 

1 

11 

41 

1.03 

0.32 

1.55 

0.11 

10160 

B 

0 

3 

11 

-1.92 

1.66 

0.27 

-0.58 

10160 

C 

0 

9 

33 

1.48 

0.46 

4.06 

0.29 

10160 

D 

0 

4 

15 

0.71 

0.60 

1.16 

-0.02 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10161 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10161 

A 

1 

22 

92 

1.98 

0.31 

0.93 

0.38 

10161 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10161 

C 

0 

2 

8 

-0.09 

0.27 

0.34 

-0.38 

10161 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10162 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10162 

A 

1 

17 

74 

1.47 

0.41 

0.90 

0.44 

10162 

B 

0 

3 

13 

-0.43 

0.27 

0.44 

-0.36 

10162 

C 

0 

2 

9 

0.38 

0.58 

1.08 

-0.13 

10162 

D 

0 

1 

4 

-0.26 

0.00 

0.48 

-0.18 

10163 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10163 

A 

1 

19 

83 

1.46 

0.32 

1.11 

0.25 

10163 

B 

0 

2 

9 

-0.19 

0.10 

0.39 

-0.35 

10163 

C 

0 

2 

9 

1.36 

0.16 

1.86 

0.01 

10163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10164 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10164 

A 

1 

17 

74 

1.56 

0.34 

0.66 

0.56 

10164 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10164 

C 

0 

2 

9 

-1.32 

0.06 

0.16 

-0.44 

10164 

D 

0 

4 

17 

-0.15 

0.86 

1.27 

-0.32 

10165 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10165 

A 

1 

14 

58 

2.03 

0.54 

0.96 

0.52 

10165 

B 

0 

3 

13 

-0.07 

0.83 

0.83 

-0.26 

10165 

C 

0 

7 

29 

0.14 

0.29 

0.81 

-0.37 

10165 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10166 

* 

-1 

1705 

90 

1.49 

0.03 

0.00 

-0.08 

10166 

A 

1 

116 

61 

2.31 

0.10 

0.97 

0.45 

10166 

B 

0 

40 

21 

1.36 

0.14 

1.04 

-0.22 

10166 

C 

0 

29 

15 

1.06 

0.23 

1.00 

-0.29 

10166 

D 

0 

4 

2 

0.49 

0.55 

0.44 

-0.17 

10167 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10167 

A 

1 

12 

50 

1.97 

0.46 

1.69 

0.64 

10167 

B 

0 

7 

29 

-0.31 

0.36 

0.44 

-0.49 

10167 

C 

0 

4 

17 

-0.24 

0.23 

0.37 

-0.32 

10167 

D 

0 

1 

4 

1.91 

0.00 

2.92 

0.12 

10168 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10168 

A 

1 

12 

50 

2.18 

0.59 

1.31 

0.46 

10168 

B 

0 

7 

29 

0.66 

0.22 

0.90 

-0.29 

10168 

C 

0 

3 

13 

1.14 

0.47 

1.51 

-0.06 

10168 

D 

0 

2 

8 

-0.11 

0.93 

0.52 

-0.27 

10169 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10169 

A 

1 

15 

63 

1.70 

0.43 

1.93 

0.41 

10169 

B 

0 

4 

17 

0.13 

0.61 

0.64 

-0.31 

10169 

C 

0 

2 

8 

-0.02 

0.49 

0.41 

-0.24 

10169 

D 

0 

3 

13 

1.03 

0.76 

1.57 

-0.04 

10170 

* 

-1 

1727 

91 

1.50 

0.03 

0.00 

-0.06 

10170 

A 

1 

64 

38 

2.61 

0.15 

1.05 

0.49 

10170 

B 

0 

68 

41 

1.20 

0.12 

0.88 

-0.37 

10170 

C 

0 

29 

17 

1.43 

0.25 

1.56 

-0.13 

10170 

D 

0 

6 

4 

1.47 

0.43 

1.05 

-0.05 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10171 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10171 

A 

1 

15 

63 

2.28 

0.44 

1.03 

0.51 

10171 

B 

0 

1 

4 

0.97 

0.00 

0.85 

-0.07 

10171 

C 

0 

4 

17 

0.87 

0.36 

0.93 

-0.18 

10171 

D 

0 

4 

17 

-0.13 

0.95 

0.84 

-0.44 

10172 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

10172 

A 

1 

7 

30 

1.04 

0.42 

1.56 

0.18 

10172 

B 

0 

8 

35 

0.41 

0.33 

0.89 

-0.24 

10172 

C 

0 

5 

22 

0.76 

0.63 

1.69 

0.00 

10172 

D 

0 

3 

13 

1.01 

0.72 

1.83 

0.09 

10173 

* 

-1 

1707 

90 

1.51 

0.03 

0.00 

-0.03 

10173 

A 

1 

93 

50 

2.20 

0.14 

1.06 

0.42 

10173 

B 

0 

48 

26 

1.32 

0.14 

1.23 

-0.16 

10173 

C 

0 

42 

22 

0.89 

0.15 

0.79 

-0.32 

10173 

D 

0 

4 

2 

1.14 

0.32 

0.77 

-0.06 

10174 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.09 

10174 

A 

1 

11 

46 

1.14 

0.48 

1.82 

0.36 

10174 

B 

0 

6 

25 

0.36 

0.50 

1.53 

-0.03 

10174 

C 

0 

3 

13 

0.20 

0.34 

0.69 

-0.06 

10174 

D 

0 

4 

17 

-1.05 

1.41 

0.81 

-0.39 

10175 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10175 

A 

1 

14 

61 

1.56 

0.29 

1.12 

0.29 

10175 

B 

0 

3 

13 

0.91 

0.89 

1.27 

-0.14 

10175 

C 

0 

5 

22 

1.26 

0.37 

1.29 

-0.02 

10175 

D 

0 

1 

4 

-0.79 

0.00 

0.13 

-0.40 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10176 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10176 

A 

1 

11 

46 

2.20 

0.53 

0.92 

0.59 

10176 

B 

0 

6 

25 

-0.03 

0.59 

0.66 

-0.36 

10176 

C 

0 

2 

8 

1.09 

1.02 

1.79 

0.00 

10176 

D 

0 

5 

21 

-0.13 

0.38 

0.43 

-0.35 

10177 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10177 

A 

1 

6 

25 

1.45 

1.12 

10.52 

-0.02 

10177 

B 

0 

4 

17 

2.30 

0.62 

1.90 

0.18 

10177 

C 

0 

4 

17 

0.90 

1.20 

1.90 

-0.14 

10177 

D 

0 

10 

42 

1.49 

0.56 

1.50 

-0.01 

10178 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10178 

A 

1 

6 

25 

1.98 

0.60 

2.25 

0.31 

10178 

B 

0 

7 

29 

1.51 

0.51 

1.91 

0.13 

10178 

C 

0 

7 

29 

1.04 

0.51 

1.09 

-0.08 

10178 

D 

0 

4 

17 

-0.10 

0.52 

0.23 

-0.42 

10179 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10179 

A 

1 

16 

73 

2.15 

0.40 

0.71 

0.66 

10179 

B 

0 

1 

5 

-1.07 

0.00 

0.18 

-0.27 

10179 

C 

0 

2 

9 

0.30 

0.44 

0.76 

-0.17 

10179 

D 

0 

3 

14 

-1.36 

0.94 

0.23 

-0.55 

10180 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10180 

A 

1 

21 

91 

1.88 

0.26 

0.95 

0.45 

10180 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10180 

C 

0 

1 

4 

-0.52 

0.00 

0.20 

-0.39 

10180 

D 

0 

1 

4 

0.35 

0.00 

0.47 

-0.23 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10181 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.08 

10181 

A 

1 

10 

42 

1.13 

0.48 

1.25 

0.40 

10181 

B 

0 

4 

17 

0.06 

0.34 

0.70 

-0.15 

10181 

C 

0 

4 

17 

-0.26 

0.24 

0.49 

-0.26 

10181 

D 

0 

6 

25 

0.27 

0.61 

1.42 

-0.10 

10182 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

10182 

A 

1 

14 

64 

1.74 

0.45 

0.97 

0.54 

10182 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10182 

C 

0 

4 

18 

0.33 

0.21 

0.76 

-0.22 

10182 

D 

0 

4 

18 

-0.44 

0.39 

0.42 

-0.45 

10183 

* 

-1 

1873 

99 

1.54 

0.03 

0.00 

0.09 

10183 

A 

1 

11 

52 

1.43 

0.52 

0.68 

0.60 

10183 

B 

0 

3 

14 

0.19 

0.15 

1.09 

-0.03 

10183 

C 

0 

3 

14 

-0.05 

0.74 

1.48 

-0.09 

10183 

D 

0 

4 

19 

-2.19 

0.55 

0.14 

-0.65 

10184 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.04 

10184 

A 

1 

13 

59 

1.33 

0.43 

1.34 

0.29 

10184 

B 

0 

4 

18 

0.94 

0.57 

1.85 

-0.02 

10184 

C 

0 

2 

9 

0.82 

0.80 

1.46 

-0.04 

10184 

D 

0 

3 

14 

-0.24 

0.36 

0.43 

-0.36 

10185 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10185 

A 

1 

17 

71 

1.58 

0.31 

0.62 

0.58 

10185 

B 

0 

1 

4 

-0.68 

0.00 

0.29 

-0.22 

10185 

C 

0 

2 

8 

1.10 

1.68 

4.81 

0.02 

10185 

D 

0 

4 

17 

-1.11 

0.45 

0.24 

-0.60 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10186 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.04 

10186 

A 

1 

9 

41 

1.96 

0.70 

1.22 

0.47 

10186 

B 

0 

7 

32 

-0.20 

0.24 

0.47 

-0.49 

10186 

C 

0 

5 

23 

1.43 

0.26 

2.28 

0.13 

10186 

D 

0 

1 

5 

-0.97 

0.00 

0.18 

-0.26 

10187 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

10187 

A 

1 

12 

52 

2.35 

0.51 

2.35 

0.37 

10187 

B 

0 

5 

22 

1.88 

0.45 

2.08 

0.04 

10187 

C 

0 

4 

17 

0.77 

0.88 

1.47 

-0.28 

10187 

D 

0 

2 

9 

-0.03 

0.76 

0.26 

-0.34 

10188 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

10188 

A 

1 

11 

48 

2.67 

0.54 

1.12 

0.63 

10188 

B 

0 

5 

22 

0.65 

0.48 

0.88 

-0.24 

10188 

C 

0 

6 

26 

0.05 

0.49 

0.59 

-0.47 

10188 

D 

0 

1 

4 

1.08 

0.00 

0.87 

-0.05 

10189 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10189 

A 

1 

8 

33 

2.45 

0.65 

1.09 

0.64 

10189 

B 

0 

4 

17 

0.15 

0.41 

0.51 

-0.24 

10189 

C 

0 

10 

42 

0.41 

0.32 

0.72 

-0.32 

10189 

D 

0 

2 

8 

-0.07 

0.03 

0.33 

-0.21 

10190 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10190 

A 

1 

10 

42 

2.33 

0.36 

0.78 

0.58 

10190 

B 

0 

3 

13 

0.92 

0.50 

0.69 

-0.10 

10190 

C 

0 

8 

33 

0.70 

0.59 

0.93 

-0.29 

10190 

D 

0 

3 

13 

-0.12 

0.17 

0.20 

-0.36 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10191 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.02 

10191 

A 

1 

13 

59 

2.58 

0.31 

0.58 

0.73 

10191 

B 

0 

3 

14 

0.33 

0.29 

0.31 

-0.43 

10191 

C 

0 

3 

14 

0.33 

0.21 

0.30 

-0.43 

10191 

D 

0 

3 

14 

1.11 

0.38 

0.72 

-0.19 

10192 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10192 

A 

1 

7 

29 

2.51 

0.40 

0.69 

0.63 

10192 

B 

0 

5 

21 

0.45 

0.65 

0.85 

-0.26 

10192 

C 

0 

8 

33 

0.64 

0.38 

0.67 

-0.26 

10192 

D 

0 

4 

17 

0.63 

0.66 

0.72 

-0.16 

10193 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10193 

A 

1 

17 

71 

1.53 

0.27 

0.79 

0.63 

10193 

B 

0 

1 

4 

-0.26 

0.00 

0.37 

-0.22 

10193 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10193 

D 

0 

6 

25 

-0.17 

0.26 

0.48 

-0.56 

10194 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10194 

A 

1 

14 

58 

2.31 

0.42 

1.34 

0.61 

10194 

B 

0 

3 

13 

0.94 

0.40 

0.93 

-0.11 

10194 

C 

0 

5 

21 

-0.16 

0.46 

0.43 

-0.48 

10194 

D 

0 

2 

8 

0.00 

1.26 

0.59 

-0.25 

10195 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10195 

A 

1 

17 

74 

1.57 

0.23 

0.79 

0.53 

10195 

B 

0 

1 

4 

-0.77 

0.00 

0.19 

-0.35 

10195 

C 

0 

3 

13 

0.99 

0.91 

2.05 

-0.07 

10195 

D 

0 

2 

9 

-0.71 

0.33 

0.21 

-0.49 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10196 

* 

-1 

1869 

99 

1.52 

0.03 

0.00 

0.00 

10196 

A 

1 

19 

76 

2.22 

0.35 

0.77 

0.62 

10196 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10196 

C 

0 

4 

16 

-0.79 

0.67 

0.32 

-0.56 

10196 

D 

0 

2 

8 

0.21 

0.98 

0.80 

-0.22 

10197 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10197 

A 

1 

19 

83 

1.69 

0.41 

1.14 

0.35 

10197 

B 

0 

1 

4 

1.54 

0.00 

2.65 

0.02 

10197 

C 

0 

1 

4 

0.07 

0.00 

0.61 

-0.16 

10197 

D 

0 

2 

9 

-0.68 

1.17 

0.51 

-0.37 

10198 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10198 

A 

1 

13 

54 

2.11 

0.45 

0.75 

0.59 

10198 

B 

0 

2 

8 

-1.68 

0.81 

0.10 

-0.47 

10198 

C 

0 

5 

21 

0.64 

0.51 

1.36 

-0.14 

10198 

D 

0 

4 

17 

-0.09 

0.68 

0.59 

-0.30 

10199 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10199 

A 

1 

15 

63 

1.47 

0.33 

1.18 

0.39 

10199 

B 

0 

3 

13 

0.86 

0.50 

1.18 

-0.09 

10199 

C 

0 

2 

8 

0.43 

1.14 

1.03 

-0.18 

10199 

D 

0 

4 

17 

0.36 

0.15 

0.57 

-0.29 

10200 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10200 

A 

1 

16 

67 

2.61 

0.30 

0.49 

0.83 

10200 

B 

0 

6 

25 

-0.62 

0.23 

0.22 

-0.70 

10200 

C 

0 

1 

4 

0.13 

0.00 

0.40 

-0.16 

10200 

D 

0 

1 

4 

-0.92 

0.00 

0.14 

-0.29 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10201 

* 

-1 

1726 

91 

1.50 

0.03 

0.00 

-0.05 

10201 

A 

1 

158 

94 

1.85 

0.10 

0.93 

0.33 

10201 

B 

0 

5 

3 

-0.17 

0.37 

0.39 

-0.26 

10201 

C 

0 

5 

3 

0.30 

0.37 

0.57 

-0.20 

10201 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10202 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10202 

A 

1 

23 

96 

1.37 

0.30 

1.02 

0.28 

10202 

B 

0 

1 

4 

-0.59 

0.00 

0.35 

-0.28 

10202 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10202 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10203 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10203 

A 

1 

22 

92 

1.54 

0.31 

0.67 

0.54 

10203 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10203 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10203 

D 

0 

2 

8 

-1.63 

0.71 

0.17 

-0.54 

10204 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10204 

A 

1 

14 

58 

2.41 

0.38 

1.32 

0.57 

10204 

B 

0 

4 

17 

1.20 

0.68 

1.30 

-0.03 

10204 

C 

0 

2 

8 

-3.22 

2.00 

0.06 

-0.63 

10204 

D 

0 

4 

17 

0.11 

0.98 

0.63 

-0.25 

10205 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

0.00 

10205 

A 

1 

22 

96 

1.72 

0.34 

0.74 

0.42 

10205 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10205 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10205 

D 

0 

1 

4 

-1.78 

0.00 

0.11 

-0.42 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10206 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.06 

10206 

A 

1 

15 

63 

1.37 

0.33 

1.09 

0.47 

10206 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10206 

C 

0 

6 

25 

-0.55 

1.05 

1.68 

-0.42 

10206 

D 

0 

3 

13 

0.06 

0.60 

0.72 

-0.14 

10207 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10207 

A 

1 

13 

54 

2.34 

0.37 

0.76 

0.55 

10207 

B 

0 

5 

21 

1.02 

0.60 

1.38 

-0.23 

10207 

C 

0 

2 

8 

1.42 

0.39 

1.05 

-0.05 

10207 

D 

0 

4 

17 

0.26 

0.42 

0.40 

-0.44 

10208 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.04 

10208 

A 

1 

19 

76 

1.48 

0.34 

0.82 

0.50 

10208 

B 

0 

1 

4 

0.00 

0.00 

0.58 

-0.12 

10208 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10208 

D 

0 

5 

20 

-0.60 

0.80 

0.59 

-0.48 

10209 

* 

-1 

1723 

91 

1.55 

0.03 

0.00 

0.05 

10209 

A 

1 

155 

91 

1.46 

0.10 

0.92 

0.36 

10209 

B 

0 

9 

5 

-0.45 

0.31 

0.46 

-0.33 

10209 

C 

0 

6 

4 

0.43 

0.51 

1.13 

-0.13 

10209 

D 

0 

1 

1 

-0.10 

0.00 

0.44 

-0.09 

10210 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10210 

A 

1 

19 

83 

1.92 

0.31 

0.87 

0.46 

10210 

B 

0 

2 

9 

-0.27 

0.31 

0.28 

-0.43 

10210 

C 

0 

2 

9 

0.75 

0.23 

0.77 

-0.20 

10210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10211 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.04 

10211 

A 

1 

18 

86 

1.08 

0.30 

1.27 

0.28 

10211 

B 

0 

3 

14 

0.09 

0.39 

0.77 

-0.28 

10211 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10212 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.01 

10212 

A 

1 

17 

77 

1.92 

0.42 

1.26 

0.28 

10212 

B 

0 

1 

5 

0.54 

0.00 

0.64 

-0.16 

10212 

C 

0 

3 

14 

1.31 

0.70 

2.16 

-0.09 

10212 

D 

0 

1 

5 

-0.14 

0.00 

0.33 

-0.25 

10213 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10213 

A 

1 

19 

83 

2.09 

0.41 

0.86 

0.49 

10213 

B 

0 

1 

4 

1.04 

0.00 

1.48 

-0.07 

10213 

C 

0 

2 

9 

-0.68 

0.42 

0.29 

-0.40 

10213 

D 

0 

1 

4 

-0.79 

0.00 

0.24 

-0.29 

10214 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10214 

A 

1 

22 

92 

1.50 

0.34 

0.95 

0.36 

10214 

B 

0 

1 

4 

-0.27 

0.00 

0.48 

-0.21 

10214 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10214 

D 

0 

1 

4 

-0.92 

0.00 

0.25 

-0.29 

10215 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10215 

A 

1 

21 

91 

1.52 

0.36 

1.10 

0.22 

10215 

B 

0 

2 

9 

0.30 

0.89 

1.13 

-0.22 

10215 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10216 

* 

-1 

1725 

91 

1.50 

0.03 

0.00 

-0.06 

10216 

A 

1 

137 

81 

2.00 

0.11 

1.09 

0.37 

10216 

B 

0 

10 

6 

0.87 

0.34 

1.05 

-0.18 

10216 

C 

0 

20 

12 

0.89 

0.16 

0.84 

-0.26 

10216 

D 

0 

2 

1 

-0.18 

0.52 

0.25 

-0.17 

10217 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10217 

A 

1 

16 

67 

1.73 

0.36 

1.63 

0.25 

10217 

B 

0 

4 

17 

1.26 

0.56 

1.58 

-0.08 

10217 

C 

0 

4 

17 

0.82 

0.42 

0.90 

-0.24 

10217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10218 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10218 

A 

1 

18 

75 

2.13 

0.34 

0.69 

0.61 

10218 

B 

0 

1 

4 

0.74 

0.00 

0.89 

-0.08 

10218 

C 

0 

3 

13 

0.47 

0.88 

1.37 

-0.21 

10218 

D 

0 

2 

8 

-2.52 

0.18 

0.03 

-0.65 

10219 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.05 

10219 

A 

1 

17 

74 

1.20 

0.33 

0.96 

0.30 

10219 

B 

0 

2 

9 

2.16 

0.61 

6.11 

0.27 

10219 

C 

0 

4 

17 

-0.72 

0.22 

0.30 

-0.55 

10219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10220 

* 

-1 

1873 

99 

1.54 

0.03 

0.00 

0.07 

10220 

A 

1 

17 

81 

1.13 

0.29 

1.02 

0.63 

10220 

B 

0 

3 

14 

-2.11 

1.56 

0.40 

-0.62 

10220 

C 

0 

1 

5 

-0.56 

0.00 

0.38 

-0.14 

10220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS First Grade Math Measure Development 


233 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10221 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10221 

A 

1 

22 

92 

1.49 

0.32 

0.95 

0.25 

10221 

B 

0 

1 

4 

1.98 

0.00 

4.84 

0.08 

10221 

C 

0 

1 

4 

-1.85 

0.00 

0.11 

-0.43 

10221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10222 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10222 

A 

1 

16 

67 

2.15 

0.41 

0.75 

0.62 

10222 

B 

0 

6 

25 

-0.19 

0.23 

0.48 

-0.54 

10222 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10222 

D 

0 

2 

8 

0.11 

0.12 

0.58 

-0.23 

10223 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10223 

A 

1 

18 

75 

1.66 

0.30 

0.84 

0.55 

10223 

B 

0 

5 

21 

-0.10 

0.23 

0.42 

-0.53 

10223 

C 

0 

1 

4 

0.54 

0.00 

0.72 

-0.11 

10223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10224 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10224 

A 

1 

18 

75 

1.59 

0.34 

1.49 

0.25 

10224 

B 

0 

2 

8 

0.49 

0.16 

0.59 

-0.22 

10224 

C 

0 

3 

13 

0.94 

0.28 

0.99 

-0.14 

10224 

D 

0 

1 

4 

1.29 

0.00 

1.30 

-0.02 

10225 

* 

-1 

1692 

89 

1.50 

0.03 

0.00 

-0.05 

10225 

A 

1 

139 

69 

2.11 

0.10 

0.96 

0.45 

10225 

B 

0 

21 

10 

0.76 

0.16 

0.63 

-0.28 

10225 

C 

0 

41 

20 

1.04 

0.18 

1.07 

-0.29 

10225 

D 

0 

1 

0 

-0.08 

0.00 

0.21 

-0.11 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10226 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10226 

A 

1 

14 

58 

2.11 

0.34 

0.94 

0.73 

10226 

B 

0 

4 

17 

-0.04 

0.37 

0.42 

-0.38 

10226 

C 

0 

2 

8 

-0.19 

0.45 

0.33 

-0.29 

10226 

D 

0 

4 

17 

0.01 

0.28 

0.40 

-0.37 

10227 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.03 

10227 

A 

1 

15 

68 

2.47 

0.30 

0.68 

0.64 

10227 

B 

0 

2 

9 

0.73 

0.46 

0.52 

-0.25 

10227 

C 

0 

3 

14 

0.50 

1.01 

0.86 

-0.38 

10227 

D 

0 

2 

9 

0.35 

0.17 

0.32 

-0.33 

10228 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10228 

A 

1 

12 

50 

2.30 

0.22 

0.59 

0.66 

10228 

B 

0 

4 

17 

-0.22 

0.39 

0.22 

-0.62 

10228 

C 

0 

3 

13 

1.90 

0.13 

1.47 

0.13 

10228 

D 

0 

5 

21 

0.62 

0.48 

0.59 

-0.35 

10229 

* 

-1 

1868 

99 

1.52 

0.03 

0.00 

-0.02 

10229 

A 

1 

18 

69 

2.36 

0.33 

0.94 

0.62 

10229 

B 

0 

2 

8 

0.05 

0.83 

0.39 

-0.31 

10229 

C 

0 

1 

4 

0.74 

0.00 

0.58 

-0.13 

10229 

D 

0 

5 

19 

0.32 

0.38 

0.50 

-0.45 

10230 

* 

-1 

1724 

91 

1.51 

0.03 

0.00 

-0.04 

10230 

A 

1 

124 

73 

2.14 

0.11 

0.92 

0.53 

10230 

B 

0 

22 

13 

0.83 

0.22 

0.87 

-0.26 

10230 

C 

0 

16 

9 

0.42 

0.20 

0.50 

-0.31 

10230 

D 

0 

8 

5 

0.09 

0.30 

0.36 

-0.27 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10231 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10231 

A 

1 

20 

87 

1.31 

0.38 

1.08 

0.26 

10231 

B 

0 

1 

4 

-1.26 

0.00 

0.21 

-0.31 

10231 

C 

0 

1 

4 

0.30 

0.00 

0.98 

-0.11 

10231 

D 

0 

1 

4 

1.03 

0.00 

2.04 

-0.01 

10232 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10232 

A 

1 

14 

61 

2.04 

0.54 

1.14 

0.51 

10232 

B 

0 

3 

13 

0.34 

0.52 

0.94 

-0.19 

10232 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10232 

D 

0 

6 

26 

-0.12 

0.48 

0.87 

-0.43 

10233 

* 

-1 

1721 

91 

1.50 

0.03 

0.00 

-0.05 

10233 

A 

1 

140 

81 

2.00 

0.09 

0.92 

0.45 

10233 

B 

0 

9 

5 

0.83 

0.28 

0.77 

-0.18 

10233 

C 

0 

18 

10 

0.71 

0.15 

0.63 

-0.29 

10233 

D 

0 

6 

3 

0.02 

0.41 

0.44 

-0.27 

10234 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10234 

A 

1 

13 

57 

2.07 

0.25 

0.56 

0.69 

10234 

B 

0 

3 

13 

-0.12 

0.19 

0.29 

-0.25 

10234 

C 

0 

3 

13 

0.16 

0.40 

0.42 

-0.19 

10234 

D 

0 

4 

17 

-0.95 

1.44 

0.53 

-0.51 

10235 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10235 

A 

1 

16 

67 

1.54 

0.36 

0.87 

0.51 

10235 

B 

0 

1 

4 

1.04 

0.00 

1.51 

0.01 

10235 

C 

0 

3 

13 

-1.76 

1.02 

0.18 

-0.61 

10235 

D 

0 

4 

17 

0.53 

0.43 

1.23 

-0.11 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10236 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.02 

10236 

A 

1 

13 

59 

2.99 

0.44 

0.48 

0.74 

10236 

B 

0 

5 

23 

0.34 

0.48 

0.63 

-0.43 

10236 

C 

0 

4 

18 

-0.02 

0.31 

0.34 

-0.47 

10236 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10237 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10237 

A 

1 

14 

61 

2.32 

0.36 

0.84 

0.55 

10237 

B 

0 

3 

13 

1.61 

0.78 

1.95 

-0.02 

10237 

C 

0 

5 

22 

0.28 

0.24 

0.36 

-0.53 

10237 

D 

0 

1 

4 

0.35 

0.00 

0.35 

-0.20 

10238 

* 

-1 

1718 

91 

1.51 

0.03 

0.00 

-0.04 

10238 

A 

1 

158 

90 

1.82 

0.09 

1.09 

0.26 

10238 

B 

0 

8 

5 

1.03 

0.44 

1.59 

-0.12 

10238 

C 

0 

9 

5 

0.63 

0.27 

0.75 

-0.21 

10238 

D 

0 

1 

1 

0.49 

0.00 

0.49 

-0.08 

10239 

* 

-1 

1871 

99 

1.51 

0.03 

0.00 

-0.07 

10239 

A 

1 

17 

74 

2.78 

0.41 

1.00 

0.42 

10239 

B 

0 

4 

17 

0.79 

0.93 

1.45 

-0.41 

10239 

C 

0 

1 

4 

1.96 

0.00 

1.52 

-0.05 

10239 

D 

0 

1 

4 

1.51 

0.00 

0.97 

-0.10 

10240 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10240 

A 

1 

18 

75 

1.89 

0.41 

1.40 

0.25 

10240 

B 

0 

1 

4 

-0.10 

0.00 

0.33 

-0.23 

10240 

C 

0 

3 

13 

1.86 

0.52 

3.08 

0.05 

10240 

D 

0 

2 

8 

0.21 

0.47 

0.49 

-0.28 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10241 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.05 

10241 

A 

1 

18 

75 

2.55 

0.40 

1.13 

0.46 

10241 

B 

0 

3 

13 

1.13 

0.71 

1.37 

-0.22 

10241 

C 

0 

3 

13 

0.37 

0.13 

0.38 

-0.39 

10241 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10242 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10242 

A 

1 

17 

74 

1.70 

0.37 

0.92 

0.46 

10242 

B 

0 

2 

9 

0.10 

0.75 

0.71 

-0.23 

10242 

C 

0 

2 

9 

0.80 

1.54 

2.73 

-0.09 

10242 

D 

0 

2 

9 

-0.80 

0.27 

0.23 

-0.40 

10243 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10243 

A 

1 

15 

63 

1.65 

0.35 

0.73 

0.65 

10243 

B 

0 

4 

17 

-0.62 

0.45 

0.39 

-0.46 

10243 

C 

0 

3 

13 

0.18 

0.12 

0.68 

-0.19 

10243 

D 

0 

2 

8 

-0.53 

0.39 

0.35 

-0.29 

10244 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.07 

10244 

A 

1 

13 

54 

1.73 

0.40 

0.86 

0.56 

10244 

B 

0 

5 

21 

0.72 

0.46 

1.33 

0.01 

10244 

C 

0 

3 

13 

0.03 

0.27 

0.49 

-0.12 

10244 

D 

0 

3 

13 

-3.17 

1.08 

0.06 

-0.73 

10245 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10245 

A 

1 

13 

54 

2.97 

0.45 

0.63 

0.69 

10245 

B 

0 

5 

21 

0.49 

0.37 

0.53 

-0.36 

10245 

C 

0 

3 

13 

0.39 

0.03 

0.39 

-0.29 

10245 

D 

0 

3 

13 

0.27 

1.16 

0.75 

-0.31 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10246 

* 

-1 

1875 

99 

1.52 

0.03 

0.00 

0.00 

10246 

A 

1 

15 

79 

2.14 

0.48 

0.75 

0.54 

10246 

B 

0 

2 

11 

-0.90 

0.82 

0.30 

-0.44 

10246 

C 

0 

1 

5 

-0.56 

0.00 

0.31 

-0.26 

10246 

D 

0 

1 

5 

0.55 

0.00 

0.94 

-0.13 

10247 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10247 

A 

1 

12 

55 

1.69 

0.41 

0.76 

0.56 

10247 

B 

0 

2 

9 

0.49 

0.89 

1.17 

-0.07 

10247 

C 

0 

3 

14 

0.04 

0.31 

0.57 

-0.20 

10247 

D 

0 

5 

23 

-0.50 

0.85 

0.87 

-0.45 

10248 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

10248 

A 

1 

16 

70 

2.04 

0.44 

1.59 

0.26 

10248 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10248 

C 

0 

4 

17 

1.40 

0.45 

1.66 

-0.10 

10248 

D 

0 

3 

13 

0.74 

0.97 

1.38 

-0.24 

10249 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10249 

A 

1 

19 

83 

1.64 

0.30 

1.19 

0.34 

10249 

B 

0 

1 

4 

1.53 

0.00 

1.86 

0.02 

10249 

C 

0 

2 

9 

0.00 

1.26 

0.77 

-0.33 

10249 

D 

0 

1 

4 

0.15 

0.00 

0.47 

-0.20 

10250 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10250 

A 

1 

17 

71 

2.25 

0.39 

0.61 

0.60 

10250 

B 

0 

2 

8 

-1.31 

0.42 

0.13 

-0.43 

10250 

C 

0 

2 

8 

1.66 

1.12 

3.86 

0.02 

10250 

D 

0 

3 

13 

-0.99 

0.85 

0.26 

-0.48 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10251 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.05 

10251 

A 

1 

15 

65 

1.47 

0.29 

0.90 

0.61 

10251 

B 

0 

7 

30 

0.05 

0.26 

0.62 

-0.48 

10251 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10251 

D 

0 

1 

4 

-1.01 

0.00 

0.18 

-0.34 

10252 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10252 

A 

1 

18 

75 

1.80 

0.41 

0.93 

0.43 

10252 

B 

0 

3 

13 

0.73 

0.40 

1.22 

-0.14 

10252 

C 

0 

1 

4 

-0.95 

0.00 

0.19 

-0.29 

10252 

D 

0 

2 

8 

-0.29 

0.11 

0.38 

-0.30 

10253 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10253 

A 

1 

20 

83 

1.34 

0.32 

0.81 

0.50 

10253 

B 

0 

3 

13 

-0.64 

0.46 

0.45 

-0.42 

10253 

C 

0 

1 

4 

-0.64 

0.00 

0.36 

-0.23 

10253 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10254 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.03 

10254 

A 

1 

19 

76 

1.92 

0.38 

0.68 

0.61 

10254 

B 

0 

4 

16 

-0.06 

0.43 

0.89 

-0.27 

10254 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10254 

D 

0 

2 

8 

-2.90 

0.86 

0.05 

-0.60 

10255 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.01 

10255 

A 

1 

18 

82 

1.94 

0.36 

0.95 

0.40 

10255 

B 

0 

2 

9 

-0.30 

0.92 

0.47 

-0.38 

10255 

C 

0 

1 

5 

-0.77 

0.00 

0.20 

-0.32 

10255 

D 

0 

1 

5 

2.43 

0.00 

4.94 

0.11 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10256 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

10256 

A 

1 

19 

83 

0.89 

0.37 

1.45 

0.24 

10256 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10256 

C 

0 

2 

9 

0.33 

0.87 

1.75 

-0.08 

10256 

D 

0 

2 

9 

-0.40 

0.53 

0.69 

-0.23 

10257 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.01 

10257 

A 

1 

17 

77 

2.28 

0.38 

0.69 

0.65 

10257 

B 

0 

2 

9 

0.10 

0.05 

0.50 

-0.27 

10257 

C 

0 

1 

5 

-1.07 

0.00 

0.15 

-0.33 

10257 

D 

0 

2 

9 

-0.84 

0.05 

0.19 

-0.44 

10258 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

10258 

A 

1 

21 

95 

1.33 

0.39 

0.97 

0.30 

10258 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10258 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10258 

D 

0 

1 

5 

-1.23 

0.00 

0.29 

-0.30 

10259 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10259 

A 

1 

18 

78 

1.73 

0.30 

0.68 

0.62 

10259 

B 

0 

2 

9 

-0.15 

0.01 

0.40 

-0.32 

10259 

C 

0 

1 

4 

-0.56 

0.00 

0.26 

-0.28 

10259 

D 

0 

2 

9 

-0.48 

0.40 

0.31 

-0.39 

10260 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10260 

A 

1 

19 

79 

2.07 

0.30 

0.76 

0.61 

10260 

B 

0 

4 

17 

0.03 

0.41 

0.45 

-0.47 

10260 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10260 

D 

0 

1 

4 

-0.97 

0.00 

0.14 

-0.36 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10261 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10261 

A 

1 

16 

67 

1.63 

0.41 

1.14 

0.40 

10261 

B 

0 

1 

4 

0.53 

0.00 

0.79 

-0.09 

10261 

C 

0 

5 

21 

0.48 

0.40 

1.05 

-0.25 

10261 

D 

0 

2 

8 

-0.06 

0.03 

0.44 

-0.26 

10262 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

10262 

A 

1 

19 

86 

1.40 

0.29 

0.70 

0.58 

10262 

B 

0 

1 

5 

-0.31 

0.00 

0.46 

-0.21 

10262 

C 

0 

2 

9 

-1.30 

0.74 

0.22 

-0.53 

10262 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10263 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10263 

A 

1 

21 

91 

1.50 

0.35 

0.86 

0.40 

10263 

B 

0 

1 

4 

-0.72 

0.00 

0.32 

-0.26 

10263 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10263 

D 

0 

1 

4 

-0.93 

0.00 

0.26 

-0.29 

10264 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10264 

A 

1 

20 

83 

2.07 

0.33 

0.69 

0.62 

10264 

B 

0 

1 

4 

-0.11 

0.00 

0.40 

-0.21 

10264 

C 

0 

3 

13 

-0.93 

0.01 

0.18 

-0.57 

10264 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10265 

* 

-1 

1867 

99 

1.53 

0.03 

0.00 

0.06 

10265 

A 

1 

13 

48 

1.90 

0.44 

0.96 

0.64 

10265 

B 

0 

4 

15 

-0.21 

0.34 

0.46 

-0.28 

10265 

C 

0 

4 

15 

0.38 

0.48 

0.95 

-0.13 

10265 

D 

0 

6 

22 

-0.36 

0.38 

0.46 

-0.42 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10266 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10266 

A 

1 

15 

63 

2.28 

0.21 

0.62 

0.70 

10266 

B 

0 

2 

8 

1.05 

1.15 

1.10 

-0.15 

10266 

C 

0 

3 

13 

0.90 

0.49 

0.67 

-0.23 

10266 

D 

0 

4 

17 

0.05 

0.36 

0.29 

-0.60 

10267 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10267 

A 

1 

19 

79 

2.26 

0.31 

0.83 

0.63 

10267 

B 

0 

2 

8 

0.45 

0.04 

0.53 

-0.24 

10267 

C 

0 

2 

8 

-0.19 

0.32 

0.29 

-0.36 

10267 

D 

0 

1 

4 

-1.78 

0.00 

0.06 

-0.45 

10268 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10268 

A 

1 

15 

63 

2.60 

0.50 

1.01 

0.65 

10268 

B 

0 

4 

17 

-0.06 

0.29 

0.45 

-0.38 

10268 

C 

0 

3 

13 

0.33 

0.13 

0.59 

-0.25 

10268 

D 

0 

2 

8 

-0.42 

0.24 

0.28 

-0.31 

10269 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.00 

10269 

A 

1 

19 

76 

2.16 

0.39 

0.67 

0.62 

10269 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10269 

C 

0 

1 

4 

-0.27 

0.00 

0.42 

-0.19 

10269 

D 

0 

5 

20 

-0.60 

0.26 

0.34 

-0.56 

10270 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.05 

10270 

A 

1 

15 

65 

1.59 

0.37 

0.75 

0.62 

10270 

B 

0 

1 

4 

-0.18 

0.00 

0.50 

-0.15 

10270 

C 

0 

2 

9 

-0.33 

0.88 

0.60 

-0.26 

10270 

D 

0 

5 

22 

-0.41 

0.33 

0.47 

-0.46 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10271 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10271 

A 

1 

18 

75 

1.50 

0.45 

1.09 

0.45 

10271 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10271 

C 

0 

6 

25 

-0.40 

0.15 

0.55 

-0.45 

10271 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10272 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10272 

A 

1 

21 

88 

1.42 

0.31 

0.66 

0.60 

10272 

B 

0 

1 

4 

-0.73 

0.00 

0.42 

-0.21 

10272 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10272 

D 

0 

2 

8 

-2.28 

1.49 

0.20 

-0.57 

10273 

* 

-1 

1703 

90 

1.48 

0.03 

0.00 

-0.10 

10273 

A 

1 

172 

90 

2.10 

0.08 

0.95 

0.37 

10273 

B 

0 

9 

5 

0.63 

0.26 

0.57 

-0.26 

10273 

C 

0 

10 

5 

0.71 

0.20 

0.54 

-0.25 

10273 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10274 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10274 

A 

-1 

23 

100 

1.20 

0.31 

0.00 

0.00 

10274 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10274 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10274 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10275 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10275 

A 

-1 

24 

100 

0.90 

0.25 

0.00 

0.00 

10275 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10275 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10275 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10276 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

10276 

A 

1 

19 

83 

2.22 

0.34 

0.69 

0.60 

10276 

B 

0 

2 

9 

0.12 

0.38 

0.47 

-0.30 

10276 

C 

0 

2 

9 

-0.95 

0.77 

0.20 

-0.50 

10276 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10277 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10277 

A 

1 

18 

75 

1.35 

0.29 

0.85 

0.46 

10277 

B 

0 

5 

21 

-0.36 

0.41 

0.53 

-0.53 

10277 

C 

0 

1 

4 

1.58 

0.00 

2.65 

0.09 

10277 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10278 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.04 

10278 

A 

1 

14 

64 

1.66 

0.31 

0.78 

0.56 

10278 

B 

0 

2 

9 

0.86 

1.12 

1.75 

-0.04 

10278 

C 

0 

1 

5 

-0.16 

0.00 

0.37 

-0.18 

10278 

D 

0 

5 

23 

-0.36 

0.68 

0.81 

-0.52 

10279 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10279 

A 

1 

13 

54 

1.91 

0.46 

1.04 

0.45 

10279 

B 

0 

8 

33 

0.46 

0.40 

1.07 

-0.38 

10279 

C 

0 

1 

4 

2.01 

0.00 

2.91 

0.10 

10279 

D 

0 

2 

8 

0.07 

0.91 

0.60 

-0.24 

10280 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.02 

10280 

A 

1 

18 

82 

2.29 

0.27 

0.64 

0.67 

10280 

B 

0 

2 

9 

-0.13 

0.80 

0.31 

-0.45 

10280 

C 

0 

1 

5 

-0.54 

0.00 

0.16 

-0.37 

10280 

D 

0 

1 

5 

0.26 

0.00 

0.35 

-0.25 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10281 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

10281 

A 

1 

10 

43 

2.61 

0.31 

0.73 

0.52 

10281 

B 

0 

5 

22 

1.60 

0.43 

1.07 

-0.06 

10281 

C 

0 

6 

26 

0.62 

0.82 

0.82 

-0.47 

10281 

D 

0 

2 

9 

1.32 

0.03 

0.54 

-0.09 

10282 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

10282 

A 

1 

17 

74 

1.04 

0.28 

1.07 

0.31 

10282 

B 

0 

2 

9 

-0.23 

0.31 

0.51 

-0.26 

10282 

C 

0 

3 

13 

0.80 

1.12 

3.36 

-0.01 

10282 

D 

0 

1 

4 

-0.90 

0.00 

0.25 

-0.29 

10283 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10283 

A 

1 

21 

91 

1.62 

0.25 

0.73 

0.51 

10283 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10283 

C 

0 

2 

9 

-0.79 

1.31 

0.44 

-0.51 

10283 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10284 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

10284 

A 

1 

14 

61 

2.55 

0.42 

0.59 

0.68 

10284 

B 

0 

3 

13 

0.30 

0.72 

0.83 

-0.25 

10284 

C 

0 

2 

9 

-0.08 

0.12 

0.34 

-0.26 

10284 

D 

0 

4 

17 

-0.45 

0.79 

0.69 

-0.47 

10285 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10285 

A 

1 

15 

65 

1.37 

0.34 

1.11 

0.34 

10285 

B 

0 

2 

9 

1.18 

0.11 

1.42 

0.03 

10285 

C 

0 

2 

9 

-0.14 

0.04 

0.38 

-0.28 

10285 

D 

0 

4 

17 

0.39 

0.85 

1.46 

-0.23 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10286 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10286 

A 

1 

14 

58 

2.03 

0.37 

0.89 

0.65 

10286 

B 

0 

4 

17 

0.28 

0.51 

0.73 

-0.29 

10286 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10286 

D 

0 

6 

25 

-0.02 

0.24 

0.43 

-0.49 

10287 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10287 

A 

1 

14 

58 

2.03 

0.34 

0.85 

0.54 

10287 

B 

0 

4 

17 

0.92 

0.30 

0.88 

-0.15 

10287 

C 

0 

1 

4 

-0.14 

0.00 

0.26 

-0.23 

10287 

D 

0 

5 

21 

0.32 

0.71 

0.85 

-0.40 

10288 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10288 

A 

1 

9 

41 

1.83 

0.29 

0.82 

0.43 

10288 

B 

0 

6 

27 

0.97 

0.39 

0.96 

-0.23 

10288 

C 

0 

1 

5 

0.78 

0.00 

0.54 

-0.12 

10288 

D 

0 

6 

27 

1.04 

0.47 

1.15 

-0.18 

10289 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10289 

A 

1 

12 

50 

2.18 

0.47 

0.65 

0.64 

10289 

B 

0 

3 

13 

-0.55 

0.54 

0.32 

-0.37 

10289 

C 

0 

3 

13 

0.19 

0.59 

0.73 

-0.20 

10289 

D 

0 

6 

25 

0.21 

0.47 

0.81 

-0.30 

10290 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

10290 

A 

1 

9 

39 

1.32 

0.57 

1.11 

0.40 

10290 

B 

0 

5 

22 

0.48 

0.43 

1.22 

-0.11 

10290 

C 

0 

4 

17 

0.45 

0.11 

0.90 

-0.10 

10290 

D 

0 

5 

22 

0.11 

0.07 

0.63 

-0.27 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10291 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10291 

A 

1 

12 

50 

2.09 

0.44 

0.76 

0.66 

10291 

B 

0 

4 

17 

-0.25 

0.76 

0.81 

-0.29 

10291 

C 

0 

3 

13 

-0.07 

0.96 

1.08 

-0.20 

10291 

D 

0 

5 

21 

-0.46 

0.54 

0.48 

-0.39 

10292 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10292 

A 

1 

19 

79 

1.48 

0.35 

1.31 

0.22 

10292 

B 

0 

4 

17 

0.67 

0.65 

1.81 

-0.20 

10292 

C 

0 

1 

4 

0.84 

0.00 

1.12 

-0.07 

10292 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10293 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10293 

A 

-1 

23 

100 

1.28 

0.34 

0.00 

0.00 

10293 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10293 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10293 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10294 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10294 

A 

-1 

24 

100 

1.43 

0.37 

0.00 

0.00 

10294 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10294 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10294 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10295 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10295 

A 

1 

21 

91 

1.50 

0.23 

1.04 

0.29 

10295 

B 

0 

2 

9 

0.44 

0.10 

0.58 

-0.29 

10295 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10295 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10296 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10296 

A 

-1 

24 

100 

1.79 

0.34 

0.00 

0.00 

10296 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10296 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10296 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10297 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10297 

A 

1 

19 

83 

1.58 

0.38 

1.27 

0.59 

10297 

B 

0 

1 

4 

1.06 

0.00 

2.27 

0.01 

10297 

C 

0 

1 

4 

-0.35 

0.00 

0.55 

-0.13 

10297 

D 

0 

2 

9 

-3.96 

1.27 

0.05 

-0.70 

10298 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10298 

A 

1 

18 

75 

2.23 

0.45 

1.11 

0.45 

10298 

B 

0 

1 

4 

0.38 

0.00 

0.61 

-0.15 

10298 

C 

0 

5 

21 

0.22 

0.58 

0.92 

-0.41 

10298 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10299 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.08 

10299 

A 

1 

22 

92 

0.82 

0.35 

0.69 

0.52 

10299 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10299 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10299 

D 

0 

2 

8 

-2.53 

0.68 

0.18 

-0.52 

10300 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10300 

A 

1 

21 

88 

1.55 

0.24 

0.69 

0.74 

10300 

B 

0 

1 

4 

-1.72 

0.00 

0.09 

-0.32 

10300 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10300 

D 

0 

2 

8 

-2.88 

2.36 

0.29 

-0.65 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10301 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10301 

A 

1 

21 

91 

1.49 

0.40 

1.07 

0.53 

10301 

B 

0 

1 

4 

-5.21 

0.00 

0.00 

-0.62 

10301 

C 

0 

1 

4 

-0.07 

0.00 

0.73 

-0.12 

10301 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10302 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10302 

A 

1 

19 

83 

1.74 

0.34 

0.94 

0.48 

10302 

B 

0 

4 

17 

-0.14 

0.27 

0.45 

-0.48 

10302 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10302 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10303 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10303 

A 

1 

15 

63 

1.66 

0.59 

1.48 

0.53 

10303 

B 

0 

3 

13 

-1.10 

0.65 

0.45 

-0.33 

10303 

C 

0 

3 

13 

-0.22 

0.25 

0.85 

-0.18 

10303 

D 

0 

3 

13 

-0.71 

0.54 

0.63 

-0.26 

10304 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10304 

A 

1 

21 

91 

1.28 

0.33 

1.33 

0.18 

10304 

B 

0 

1 

4 

-0.08 

0.00 

0.61 

-0.19 

10304 

C 

0 

1 

4 

0.80 

0.00 

1.48 

-0.06 

10304 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10305 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

10305 

A 

1 

16 

73 

2.17 

0.41 

0.39 

0.77 

10305 

B 

0 

3 

14 

-0.91 

0.19 

0.34 

-0.35 

10305 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10305 

D 

0 

3 

14 

-2.64 

0.66 

0.09 

-0.65 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10306 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10306 

A 

1 

22 

96 

1.50 

0.32 

0.92 

0.29 

10306 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10306 

C 

0 

1 

4 

-0.61 

0.00 

0.28 

-0.29 

10306 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10307 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

10307 

A 

1 

19 

83 

1.11 

0.28 

0.73 

0.58 

10307 

B 

0 

1 

4 

0.37 

0.00 

1.19 

-0.05 

10307 

C 

0 

1 

4 

-1.26 

0.00 

0.23 

-0.30 

10307 

D 

0 

2 

9 

-1.71 

0.79 

0.20 

-0.53 

10308 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10308 

A 

1 

21 

88 

1.21 

0.32 

0.89 

0.36 

10308 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10308 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10308 

D 

0 

3 

13 

-0.38 

0.55 

0.56 

-0.36 

10309 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10309 

A 

1 

19 

83 

1.67 

0.44 

0.80 

0.59 

10309 

B 

0 

1 

4 

-0.20 

0.00 

0.65 

-0.11 

10309 

C 

0 

2 

9 

-1.23 

0.02 

0.23 

-0.30 

10309 

D 

0 

1 

4 

-5.24 

0.00 

0.00 

-0.57 

10310 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10310 

A 

1 

21 

88 

2.07 

0.43 

1.01 

0.39 

10310 

B 

0 

3 

13 

-0.35 

1.03 

1.31 

-0.39 

10310 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10311 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.03 

10311 

A 

1 

21 

91 

1.84 

0.46 

1.19 

-0.02 

10311 

B 

0 

1 

4 

0.41 

0.00 

0.96 

-0.15 

10311 

C 

0 

1 

4 

3.50 

0.00 

21.08 

0.17 

10311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10312 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10312 

A 

1 

20 

87 

1.56 

0.28 

0.52 

0.72 

10312 

B 

0 

1 

4 

-2.04 

0.00 

0.11 

-0.39 

10312 

C 

0 

1 

4 

-1.00 

0.00 

0.31 

-0.26 

10312 

D 

0 

1 

4 

-3.21 

0.00 

0.03 

-0.54 

10313 

* 

-1 

1723 

91 

1.49 

0.03 

0.00 

-0.07 

10313 

A 

1 

127 

74 

2.09 

0.10 

1.05 

0.35 

10313 

B 

0 

19 

11 

1.63 

0.24 

1.91 

-0.06 

10313 

C 

0 

24 

14 

0.69 

0.15 

0.55 

-0.39 

10313 

D 

0 

1 

1 

2.07 

0.00 

1.72 

0.01 

10314 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10314 

A 

1 

12 

50 

2.29 

0.55 

1.15 

0.45 

10314 

B 

0 

3 

13 

1.38 

0.31 

1.52 

-0.03 

10314 

C 

0 

3 

13 

0.06 

0.58 

0.51 

-0.33 

10314 

D 

0 

6 

25 

0.82 

0.58 

2.64 

-0.24 

10315 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

0.00 

10315 

A 

1 

15 

65 

2.56 

0.47 

1.11 

0.56 

10315 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10315 

C 

0 

3 

13 

0.89 

0.83 

1.26 

-0.11 

10315 

D 

0 

5 

22 

-0.90 

1.29 

0.97 

-0.55 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10316 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10316 

A 

1 

14 

58 

1.88 

0.38 

1.17 

0.61 

10316 

B 

0 

5 

21 

0.15 

0.40 

0.77 

-0.35 

10316 

C 

0 

4 

17 

-0.06 

0.45 

0.56 

-0.37 

10316 

D 

0 

1 

4 

0.30 

0.00 

0.59 

-0.12 

10317 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10317 

A 

1 

12 

52 

2.04 

0.43 

0.82 

0.62 

10317 

B 

0 

2 

9 

0.09 

0.09 

0.48 

-0.21 

10317 

C 

0 

5 

22 

0.57 

0.56 

1.36 

-0.20 

10317 

D 

0 

4 

17 

-0.30 

0.22 

0.35 

-0.44 

10318 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10318 

A 

1 

17 

74 

2.26 

0.35 

0.82 

0.59 

10318 

B 

0 

3 

13 

0.79 

0.46 

0.89 

-0.23 

10318 

C 

0 

2 

9 

-0.76 

0.01 

0.15 

-0.48 

10318 

D 

0 

1 

4 

0.06 

0.00 

0.34 

-0.22 

10319 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10319 

A 

1 

10 

42 

2.48 

0.29 

0.61 

0.57 

10319 

B 

0 

4 

17 

0.21 

0.45 

0.32 

-0.37 

10319 

C 

0 

6 

25 

0.53 

0.68 

1.14 

-0.36 

10319 

D 

0 

4 

17 

1.56 

0.90 

2.05 

0.03 

10320 

* 

-1 

1717 

91 

1.52 

0.03 

0.00 

-0.02 

10320 

A 

1 

141 

80 

1.82 

0.09 

0.89 

0.40 

10320 

B 

0 

13 

7 

0.94 

0.29 

1.29 

-0.17 

10320 

C 

0 

21 

12 

0.70 

0.21 

0.91 

-0.30 

10320 

D 

0 

2 

1 

-0.32 

0.34 

0.22 

-0.19 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10321 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10321 

A 

1 

15 

65 

2.23 

0.27 

0.57 

0.80 

10321 

B 

0 

3 

13 

0.03 

0.19 

0.36 

-0.36 

10321 

C 

0 

3 

13 

0.00 

0.42 

0.39 

-0.37 

10321 

D 

0 

2 

9 

-0.83 

0.06 

0.15 

-0.47 

10322 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.06 

10322 

A 

1 

16 

70 

1.42 

0.45 

1.00 

0.52 

10322 

B 

0 

2 

9 

-0.49 

0.89 

0.77 

-0.23 

10322 

C 

0 

2 

9 

-0.75 

0.19 

0.42 

-0.28 

10322 

D 

0 

3 

13 

-0.49 

0.14 

0.54 

-0.29 

10323 

* 

-1 

1702 

90 

1.53 

0.03 

0.00 

0.01 

10323 

A 

1 

155 

81 

1.67 

0.10 

0.97 

0.34 

10323 

B 

0 

17 

9 

0.70 

0.27 

1.23 

-0.20 

10323 

C 

0 

20 

10 

0.55 

0.20 

0.95 

-0.26 

10323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10324 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10324 

A 

1 

17 

74 

1.73 

0.34 

0.95 

0.42 

10324 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10324 

C 

0 

6 

26 

0.42 

0.32 

0.76 

-0.42 

10324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10325 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10325 

A 

1 

12 

52 

2.30 

0.45 

0.76 

0.64 

10325 

B 

0 

4 

17 

0.28 

0.72 

0.84 

-0.28 

10325 

C 

0 

6 

26 

0.11 

0.34 

0.54 

-0.43 

10325 

D 

0 

1 

4 

0.30 

0.00 

0.51 

-0.13 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10326 

* 

-1 

1871 

99 

1.54 

0.03 

0.00 

0.08 

10326 

A 

1 

15 

65 

1.16 

0.35 

0.97 

0.51 

10326 

B 

0 

2 

9 

-0.04 

0.31 

0.62 

-0.10 

10326 

C 

0 

4 

17 

0.32 

0.44 

1.15 

-0.05 

10326 

D 

0 

2 

9 

-3.50 

1.72 

0.10 

-0.69 

10327 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10327 

A 

1 

17 

74 

1.50 

0.37 

1.61 

0.06 

10327 

B 

0 

3 

13 

1.93 

0.91 

5.41 

0.13 

10327 

C 

0 

3 

13 

0.66 

0.72 

1.14 

-0.21 

10327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10328 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

10328 

A 

1 

15 

68 

1.62 

0.36 

1.31 

0.48 

10328 

B 

0 

1 

5 

-0.70 

0.00 

0.22 

-0.30 

10328 

C 

0 

3 

14 

0.19 

0.40 

0.63 

-0.29 

10328 

D 

0 

3 

14 

0.58 

0.41 

0.91 

-0.18 

10329 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10329 

A 

1 

16 

67 

1.63 

0.19 

0.61 

0.67 

10329 

B 

0 

2 

8 

-0.37 

0.31 

0.31 

-0.30 

10329 

C 

0 

4 

17 

0.60 

0.53 

1.26 

-0.13 

10329 

D 

0 

2 

8 

-2.07 

1.13 

0.09 

-0.68 

10330 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10330 

A 

1 

16 

67 

1.64 

0.26 

0.50 

0.77 

10330 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10330 

C 

0 

5 

21 

-0.61 

0.34 

0.38 

-0.51 

10330 

D 

0 

3 

13 

-1.02 

0.60 

0.28 

-0.48 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10331 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.03 

10331 

A 

1 

22 

88 

1.34 

0.33 

0.98 

0.33 

10331 

B 

0 

1 

4 

-1.21 

0.00 

0.20 

-0.32 

10331 

C 

0 

2 

8 

0.26 

0.21 

0.90 

-0.17 

10331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10332 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10332 

A 

1 

15 

65 

2.03 

0.42 

1.10 

0.57 

10332 

B 

0 

3 

13 

-0.60 

0.74 

0.39 

-0.45 

10332 

C 

0 

5 

22 

0.40 

0.34 

0.75 

-0.29 

10332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10333 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.01 

10333 

A 

1 

17 

77 

2.05 

0.35 

0.87 

0.45 

10333 

B 

0 

2 

9 

1.06 

0.41 

1.04 

-0.14 

10333 

C 

0 

3 

14 

0.06 

0.63 

0.54 

-0.44 

10333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10334 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10334 

A 

1 

22 

92 

1.48 

0.37 

1.12 

0.15 

10334 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10334 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10334 

D 

0 

2 

8 

0.60 

0.31 

1.15 

-0.15 

10335 

* 

-1 

1715 

91 

1.50 

0.03 

0.00 

-0.05 

10335 

A 

1 

172 

96 

1.81 

0.09 

1.00 

0.28 

10335 

B 

0 

2 

1 

-0.21 

1.12 

0.49 

-0.16 

10335 

C 

0 

5 

3 

0.07 

0.30 

0.45 

-0.22 

10335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10336 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10336 

A 

1 

20 

87 

1.24 

0.28 

1.19 

0.26 

10336 

B 

0 

1 

4 

0.95 

0.00 

1.29 

-0.03 

10336 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10336 

D 

0 

2 

9 

0.05 

0.14 

0.53 

-0.28 

10337 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.05 

10337 

A 

1 

15 

71 

1.32 

0.48 

0.95 

0.43 

10337 

B 

0 

2 

10 

0.46 

0.56 

1.61 

-0.06 

10337 

C 

0 

1 

5 

-0.95 

0.00 

0.34 

-0.22 

10337 

D 

0 

3 

14 

-0.80 

0.99 

0.89 

-0.36 

10338 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

-0.02 

10338 

A 

1 

20 

95 

1.88 

0.25 

0.98 

0.27 

10338 

B 

0 

1 

5 

0.50 

0.00 

0.42 

-0.27 

10338 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10339 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10339 

A 

1 

20 

87 

1.56 

0.39 

0.97 

0.46 

10339 

B 

0 

3 

13 

-0.88 

0.35 

0.36 

-0.46 

10339 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10340 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10340 

A 

1 

21 

95 

1.48 

0.26 

0.96 

0.36 

10340 

B 

0 

1 

5 

-0.64 

0.00 

0.26 

-0.36 

10340 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10341 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.01 

10341 

A 

1 

16 

73 

2.13 

0.34 

1.09 

0.56 

10341 

B 

0 

3 

14 

0.38 

0.38 

0.49 

-0.35 

10341 

C 

0 

2 

9 

-0.29 

0.43 

0.24 

-0.42 

10341 

D 

0 

1 

5 

1.44 

0.00 

1.22 

-0.03 

10342 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10342 

A 

1 

19 

83 

1.35 

0.34 

1.20 

0.48 

10342 

B 

0 

2 

9 

-0.02 

0.09 

0.62 

-0.21 

10342 

C 

0 

1 

4 

-0.91 

0.00 

0.26 

-0.27 

10342 

D 

0 

1 

4 

-1.26 

0.00 

0.18 

-0.32 

10343 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.07 

10343 

A 

1 

21 

88 

1.03 

0.25 

0.66 

0.61 

10343 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10343 

C 

0 

2 

8 

-0.72 

0.39 

0.50 

-0.28 

10343 

D 

0 

1 

4 

-3.76 

0.00 

0.02 

-0.62 

10344 

* 

-1 

1871 

99 

1.54 

0.03 

0.00 

0.07 

10344 

A 

1 

18 

78 

1.13 

0.32 

0.71 

0.58 

10344 

B 

0 

2 

9 

-0.17 

0.24 

0.75 

-0.17 

10344 

C 

0 

1 

4 

-1.21 

0.00 

0.26 

-0.27 

10344 

D 

0 

2 

9 

-1.71 

0.78 

0.21 

-0.49 

10345 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.03 

10345 

A 

1 

21 

88 

2.08 

0.36 

1.10 

0.35 

10345 

B 

0 

1 

4 

-0.10 

0.00 

0.34 

-0.26 

10345 

C 

0 

2 

8 

0.60 

0.46 

0.75 

-0.24 

10345 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10346 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10346 

A 

1 

22 

92 

1.63 

0.40 

1.07 

0.24 

10346 

B 

0 

1 

4 

0.73 

0.00 

1.40 

-0.09 

10346 

C 

0 

1 

4 

-0.56 

0.00 

0.38 

-0.24 

10346 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10347 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10347 

A 

1 

20 

83 

1.86 

0.35 

0.78 

0.51 

10347 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10347 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10347 

D 

0 

4 

17 

-0.49 

0.60 

0.57 

-0.51 

10348 

* 

-1 

1701 

90 

1.53 

0.03 

0.00 

0.02 

10348 

A 

1 

180 

93 

1.57 

0.09 

0.93 

0.36 

10348 

B 

0 

10 

5 

-0.06 

0.21 

0.50 

-0.28 

10348 

C 

0 

3 

2 

-0.97 

0.62 

0.23 

-0.24 

10348 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10349 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.06 

10349 

A 

1 

17 

81 

1.01 

0.42 

1.07 

0.36 

10349 

B 

0 

1 

5 

-0.40 

0.00 

0.65 

-0.15 

10349 

C 

0 

3 

14 

-0.53 

0.34 

0.63 

-0.31 

10349 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10350 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10350 

A 

1 

20 

91 

1.10 

0.30 

0.90 

0.40 

10350 

B 

0 

1 

5 

-0.97 

0.00 

0.28 

-0.30 

10350 

C 

0 

1 

5 

-0.68 

0.00 

0.37 

-0.26 

10350 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10351 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10351 

A 

1 

22 

92 

0.84 

0.27 

1.00 

0.24 

10351 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10351 

C 

0 

1 

4 

0.21 

0.00 

0.91 

-0.09 

10351 

D 

0 

1 

4 

-0.70 

0.00 

0.37 

-0.24 

10352 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10352 

A 

1 

22 

92 

1.33 

0.37 

0.87 

0.38 

10352 

B 

0 

1 

4 

-1.26 

0.00 

0.24 

-0.28 

10352 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10352 

D 

0 

1 

4 

-0.93 

0.00 

0.33 

-0.25 

10353 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10353 

A 

1 

21 

91 

1.51 

0.33 

1.15 

0.24 

10353 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10353 

C 

0 

1 

4 

-0.73 

0.00 

0.27 

-0.31 

10353 

D 

0 

1 

4 

1.22 

0.00 

1.88 

-0.03 

10354 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.05 

10354 

A 

1 

16 

70 

1.54 

0.36 

0.77 

0.65 

10354 

B 

0 

3 

13 

-0.53 

0.62 

0.52 

-0.33 

10354 

C 

0 

3 

13 

-1.21 

0.22 

0.21 

-0.49 

10354 

D 

0 

1 

4 

-0.08 

0.00 

0.62 

-0.12 

10355 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10355 

A 

1 

20 

83 

1.85 

0.36 

1.24 

0.12 

10355 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10355 

C 

0 

3 

13 

0.82 

0.76 

1.17 

-0.23 

10355 

D 

0 

1 

4 

3.01 

0.00 

6.93 

0.16 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10356 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10356 

A 

1 

20 

83 

1.05 

0.25 

1.13 

0.41 

10356 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10356 

C 

0 

3 

13 

-0.69 

0.54 

0.45 

-0.48 

10356 

D 

0 

1 

4 

1.05 

0.00 

1.93 

0.04 

10357 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.04 

10357 

A 

1 

20 

83 

2.44 

0.27 

0.70 

0.62 

10357 

B 

0 

2 

8 

0.46 

0.12 

0.38 

-0.36 

10357 

C 

0 

2 

8 

-0.10 

0.25 

0.22 

-0.48 

10357 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10358 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10358 

A 

1 

15 

63 

2.01 

0.29 

0.53 

0.75 

10358 

B 

0 

6 

25 

-0.18 

0.29 

0.42 

-0.56 

10358 

C 

0 

2 

8 

0.01 

0.41 

0.46 

-0.25 

10358 

D 

0 

1 

4 

-0.67 

0.00 

0.21 

-0.27 

10359 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10359 

A 

1 

18 

75 

2.03 

0.23 

0.54 

0.72 

10359 

B 

0 

2 

8 

-0.29 

0.68 

0.32 

-0.39 

10359 

C 

0 

2 

8 

0.40 

1.22 

0.96 

-0.23 

10359 

D 

0 

2 

8 

-0.84 

0.06 

0.15 

-0.51 

10360 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10360 

A 

1 

12 

55 

2.10 

0.38 

0.85 

0.55 

10360 

B 

0 

7 

32 

0.51 

0.60 

1.22 

-0.37 

10360 

C 

0 

1 

5 

0.68 

0.00 

0.62 

-0.09 

10360 

D 

0 

2 

9 

-0.05 

0.43 

0.32 

-0.29 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10361 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10361 

A 

1 

17 

74 

1.78 

0.46 

1.19 

0.48 

10361 

B 

0 

2 

9 

-0.48 

0.63 

0.46 

-0.29 

10361 

C 

0 

2 

9 

0.22 

0.04 

0.77 

-0.18 

10361 

D 

0 

2 

9 

-0.42 

0.24 

0.42 

-0.28 

10362 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10362 

A 

1 

19 

79 

2.23 

0.29 

0.78 

0.64 

10362 

B 

0 

2 

8 

-0.70 

0.85 

0.23 

-0.47 

10362 

C 

0 

3 

13 

0.12 

0.53 

0.47 

-0.39 

10362 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10363 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10363 

A 

1 

20 

83 

1.62 

0.36 

1.02 

0.51 

10363 

B 

0 

1 

4 

-0.75 

0.00 

0.24 

-0.20 

10363 

C 

0 

3 

13 

-1.27 

2.02 

1.34 

-0.45 

10363 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10364 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

10364 

A 

1 

16 

73 

1.89 

0.44 

0.78 

0.53 

10364 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10364 

C 

0 

5 

23 

0.05 

0.38 

0.79 

-0.37 

10364 

D 

0 

1 

5 

-1.78 

0.00 

0.09 

-0.37 

10365 

* 

-1 

1868 

99 

1.53 

0.03 

0.00 

0.03 

10365 

A 

1 

19 

73 

1.76 

0.33 

0.77 

0.57 

10365 

B 

0 

2 

8 

-0.73 

0.53 

0.28 

-0.34 

10365 

C 

0 

2 

8 

0.52 

0.61 

1.02 

-0.12 

10365 

D 

0 

3 

12 

-0.70 

1.01 

0.48 

-0.42 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10366 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10366 

A 

1 

18 

78 

1.48 

0.30 

0.84 

0.46 

10366 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10366 

C 

0 

1 

4 

2.80 

0.00 

9.54 

0.22 

10366 

D 

0 

4 

17 

-1.10 

0.87 

0.52 

-0.62 

10367 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.07 

10367 

A 

1 

14 

67 

1.12 

0.30 

0.73 

0.57 

10367 

B 

0 

2 

10 

-0.57 

0.64 

0.45 

-0.33 

10367 

C 

0 

2 

10 

-0.54 

0.84 

0.52 

-0.32 

10367 

D 

0 

3 

14 

0.00 

0.50 

0.84 

-0.22 

10368 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.05 

10368 

A 

1 

6 

24 

2.28 

0.53 

0.57 

0.60 

10368 

B 

0 

2 

8 

0.61 

0.61 

0.76 

-0.07 

10368 

C 

0 

10 

40 

0.51 

0.33 

0.97 

-0.27 

10368 

D 

0 

7 

28 

0.45 

0.41 

0.87 

-0.23 

10369 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10369 

A 

1 

21 

88 

1.67 

0.37 

1.14 

0.16 

10369 

B 

0 

1 

4 

2.14 

0.00 

4.11 

0.07 

10369 

C 

0 

1 

4 

0.31 

0.00 

0.66 

-0.16 

10369 

D 

0 

1 

4 

0.27 

0.00 

0.64 

-0.17 

10370 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10370 

A 

1 

11 

48 

2.10 

0.42 

0.76 

0.69 

10370 

B 

0 

5 

22 

0.34 

0.20 

0.56 

-0.29 

10370 

C 

0 

3 

13 

0.27 

0.28 

0.52 

-0.23 

10370 

D 

0 

4 

17 

-0.09 

0.32 

0.39 

-0.39 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10371 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10371 

A 

1 

8 

33 

1.90 

0.52 

1.50 

0.51 

10371 

B 

0 

7 

29 

0.89 

0.56 

1.75 

0.02 

10371 

C 

0 

4 

17 

0.09 

0.25 

0.38 

-0.24 

10371 

D 

0 

5 

21 

-0.27 

0.46 

0.41 

-0.40 

10372 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.04 

10372 

A 

1 

14 

70 

1.52 

0.56 

1.84 

0.43 

10372 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10372 

C 

0 

3 

15 

-0.40 

0.48 

0.63 

-0.27 

10372 

D 

0 

3 

15 

-0.46 

1.43 

1.53 

-0.28 

10373 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10373 

A 

1 

20 

83 

1.45 

0.28 

0.55 

0.69 

10373 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10373 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10373 

D 

0 

4 

17 

-1.57 

0.57 

0.25 

-0.69 

10374 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10374 

A 

1 

18 

78 

2.01 

0.32 

0.93 

0.42 

10374 

B 

0 

1 

4 

1.96 

0.00 

2.13 

0.04 

10374 

C 

0 

1 

4 

0.26 

0.00 

0.39 

-0.22 

10374 

D 

0 

3 

13 

0.24 

0.61 

0.53 

-0.41 

10375 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10375 

A 

1 

19 

79 

1.31 

0.35 

0.91 

0.51 

10375 

B 

0 

2 

8 

-3.47 

1.75 

0.13 

-0.65 

10375 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10375 

D 

0 

3 

13 

0.34 

0.80 

1.58 

-0.09 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10376 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10376 

A 

1 

18 

75 

1.71 

0.35 

0.66 

0.62 

10376 

B 

0 

2 

8 

-0.22 

0.25 

0.49 

-0.24 

10376 

C 

0 

3 

13 

-0.37 

0.21 

0.43 

-0.33 

10376 

D 

0 

1 

4 

-2.69 

0.00 

0.04 

-0.47 

10377 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10377 

A 

1 

19 

79 

1.56 

0.33 

0.89 

0.50 

10377 

B 

0 

2 

8 

0.89 

0.37 

1.53 

-0.05 

10377 

C 

0 

1 

4 

-0.94 

0.00 

0.23 

-0.28 

10377 

D 

0 

2 

8 

-1.32 

0.40 

0.17 

-0.48 

10378 

* 

-1 

1715 

91 

1.51 

0.03 

0.00 

-0.03 

10378 

A 

1 

160 

89 

1.86 

0.09 

0.82 

0.46 

10378 

B 

0 

12 

7 

-0.57 

0.25 

0.28 

-0.45 

10378 

C 

0 

6 

3 

0.85 

0.30 

0.99 

-0.11 

10378 

D 

0 

1 

1 

-0.41 

0.00 

0.23 

-0.12 

10379 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10379 

A 

1 

18 

75 

1.53 

0.21 

0.41 

0.85 

10379 

B 

0 

3 

13 

-1.42 

0.17 

0.19 

-0.53 

10379 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10379 

D 

0 

3 

13 

-1.66 

0.50 

0.18 

-0.59 

10380 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

10380 

A 

1 

19 

83 

1.62 

0.37 

1.45 

0.20 

10380 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10380 

C 

0 

1 

4 

-0.40 

0.00 

0.29 

-0.27 

10380 

D 

0 

3 

13 

1.22 

0.03 

1.49 

-0.07 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10381 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10381 

A 

1 

14 

64 

2.09 

0.43 

0.99 

0.56 

10381 

B 

0 

3 

14 

0.72 

0.83 

1.74 

-0.15 

10381 

C 

0 

1 

5 

0.11 

0.00 

0.46 

-0.16 

10381 

D 

0 

4 

18 

-0.32 

0.57 

0.44 

-0.47 

10382 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10382 

A 

1 

14 

58 

1.98 

0.37 

0.55 

0.73 

10382 

B 

0 

3 

13 

-0.39 

0.52 

0.45 

-0.35 

10382 

C 

0 

3 

13 

-0.69 

0.26 

0.28 

-0.42 

10382 

D 

0 

4 

17 

0.05 

0.11 

0.57 

-0.28 

10383 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10383 

A 

1 

12 

50 

1.49 

0.41 

1.02 

0.44 

10383 

B 

0 

7 

29 

0.54 

0.30 

1.04 

-0.16 

10383 

C 

0 

3 

13 

-0.95 

0.72 

0.27 

-0.50 

10383 

D 

0 

2 

8 

1.15 

0.55 

1.71 

0.06 

10384 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10384 

A 

1 

15 

65 

2.33 

0.38 

0.70 

0.63 

10384 

B 

0 

2 

9 

0.63 

0.28 

0.63 

-0.20 

10384 

C 

0 

3 

13 

-0.25 

0.16 

0.26 

-0.47 

10384 

D 

0 

3 

13 

0.65 

0.42 

0.75 

-0.25 

10385 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.01 

10385 

A 

1 

13 

62 

2.18 

0.26 

0.60 

0.72 

10385 

B 

0 

6 

29 

0.69 

0.21 

0.58 

-0.36 

10385 

C 

0 

1 

5 

-0.35 

0.00 

0.19 

-0.31 

10385 

D 

0 

1 

5 

-1.85 

0.00 

0.04 

-0.56 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10386 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10386 

A 

1 

12 

50 

1.87 

0.39 

0.96 

0.52 

10386 

B 

0 

3 

13 

1.69 

0.36 

2.01 

0.15 

10386 

C 

0 

6 

25 

-0.10 

0.48 

0.48 

-0.51 

10386 

D 

0 

3 

13 

0.20 

0.25 

0.42 

-0.26 

10387 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10387 

A 

1 

18 

75 

1.32 

0.24 

0.91 

0.51 

10387 

B 

0 

1 

4 

-0.40 

0.00 

0.31 

-0.29 

10387 

C 

0 

4 

17 

0.36 

0.17 

0.70 

-0.28 

10387 

D 

0 

1 

4 

-0.47 

0.00 

0.29 

-0.30 

10388 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.05 

10388 

A 

1 

17 

81 

1.03 

0.27 

1.04 

0.29 

10388 

B 

0 

2 

10 

0.32 

0.59 

0.97 

-0.16 

10388 

C 

0 

1 

5 

-1.21 

0.00 

0.18 

-0.42 

10388 

D 

0 

1 

5 

1.35 

0.00 

2.31 

0.10 

10389 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10389 

A 

1 

14 

64 

1.59 

0.24 

0.69 

0.65 

10389 

B 

0 

2 

9 

-0.35 

0.33 

0.33 

-0.29 

10389 

C 

0 

3 

14 

0.95 

0.28 

1.23 

0.01 

10389 

D 

0 

3 

14 

-1.46 

0.89 

0.18 

-0.68 

10390 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.04 

10390 

A 

1 

16 

67 

1.70 

0.41 

0.87 

0.54 

10390 

B 

0 

1 

4 

-1.21 

0.00 

0.16 

-0.29 

10390 

C 

0 

7 

29 

-0.03 

0.35 

0.76 

-0.43 

10390 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10391 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10391 

A 

1 

16 

67 

1.90 

0.33 

1.29 

0.27 

10391 

B 

0 

5 

21 

1.15 

0.43 

1.18 

-0.21 

10391 

C 

0 

2 

8 

0.85 

1.26 

1.06 

-0.20 

10391 

D 

0 

1 

4 

2.01 

0.00 

1.79 

0.06 

10392 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10392 

A 

1 

17 

71 

1.25 

0.34 

0.99 

0.35 

10392 

B 

0 

5 

21 

0.38 

0.45 

1.24 

-0.23 

10392 

C 

0 

2 

8 

-0.05 

0.35 

0.57 

-0.23 

10392 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10393 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10393 

A 

1 

11 

48 

2.34 

0.57 

0.98 

0.52 

10393 

B 

0 

5 

22 

-0.04 

0.45 

0.53 

-0.29 

10393 

C 

0 

5 

22 

1.13 

0.52 

2.25 

-0.01 

10393 

D 

0 

2 

9 

-2.28 

2.94 

0.75 

-0.49 

10394 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.01 

10394 

A 

1 

21 

88 

2.04 

0.31 

0.67 

0.62 

10394 

B 

0 

1 

4 

-0.82 

0.00 

0.22 

-0.31 

10394 

C 

0 

1 

4 

-0.64 

0.00 

0.26 

-0.29 

10394 

D 

0 

1 

4 

-1.59 

0.00 

0.10 

-0.41 

10395 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.06 

10395 

A 

1 

20 

83 

1.29 

0.34 

0.66 

0.59 

10395 

B 

0 

1 

4 

-1.11 

0.00 

0.31 

-0.22 

10395 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10395 

D 

0 

3 

13 

-1.76 

1.01 

0.30 

-0.54 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10396 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10396 

A 

1 

21 

88 

1.93 

0.31 

0.64 

0.58 

10396 

B 

0 

1 

4 

-0.25 

0.00 

0.38 

-0.22 

10396 

C 

0 

1 

4 

-0.17 

0.00 

0.40 

-0.21 

10396 

D 

0 

1 

4 

-2.69 

0.00 

0.03 

-0.52 

10397 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.01 

10397 

A 

1 

19 

76 

1.79 

0.20 

0.80 

0.55 

10397 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10397 

C 

0 

5 

20 

0.62 

0.52 

1.02 

-0.38 

10397 

D 

0 

1 

4 

-0.85 

0.00 

0.13 

-0.42 

10398 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.03 

10398 

A 

1 

15 

71 

1.71 

0.41 

1.14 

0.45 

10398 

B 

0 

1 

5 

-5.21 

0.00 

0.00 

-0.68 

10398 

C 

0 

3 

14 

-0.01 

0.32 

0.50 

-0.22 

10398 

D 

0 

2 

10 

1.51 

1.75 

6.13 

0.06 

10399 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

10399 

A 

1 

19 

79 

2.06 

0.37 

0.67 

0.59 

10399 

B 

0 

1 

4 

0.00 

0.00 

0.47 

-0.16 

10399 

C 

0 

3 

13 

0.00 

0.32 

0.52 

-0.29 

10399 

D 

0 

1 

4 

-3.76 

0.00 

0.01 

-0.57 

10400 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10400 

A 

1 

21 

88 

1.31 

0.30 

1.03 

0.17 

10400 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10400 

C 

0 

2 

8 

0.79 

1.37 

2.31 

-0.10 

10400 

D 

0 

1 

4 

0.30 

0.00 

0.67 

-0.14 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10401 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10401 

A 

1 

23 

96 

1.32 

0.34 

1.09 

-0.11 

10401 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10401 

C 

0 

1 

4 

2.24 

0.00 

6.02 

0.11 

10401 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10402 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10402 

A 

1 

20 

83 

1.30 

0.28 

1.14 

0.13 

10402 

B 

0 

2 

8 

0.15 

0.82 

0.76 

-0.27 

10402 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10402 

D 

0 

2 

8 

1.63 

0.57 

2.87 

0.10 

10403 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10403 

A 

1 

19 

79 

1.53 

0.29 

0.81 

0.54 

10403 

B 

0 

1 

4 

0.49 

0.00 

0.86 

-0.10 

10403 

C 

0 

3 

13 

-0.50 

0.87 

0.67 

-0.45 

10403 

D 

0 

1 

4 

-0.59 

0.00 

0.29 

-0.26 

10404 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

0.00 

10404 

A 

1 

15 

65 

1.98 

0.41 

1.11 

0.37 

10404 

B 

0 

4 

17 

1.04 

0.72 

1.59 

-0.14 

10404 

C 

0 

1 

4 

-0.18 

0.00 

0.27 

-0.23 

10404 

D 

0 

3 

13 

0.59 

1.19 

1.35 

-0.23 

10405 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10405 

A 

1 

2 

8 

1.22 

0.09 

2.88 

-0.05 

10405 

B 

0 

5 

21 

1.94 

0.93 

2.71 

0.18 

10405 

C 

0 

14 

58 

1.42 

0.35 

1.24 

-0.02 

10405 

D 

0 

3 

13 

0.88 

0.78 

0.45 

-0.16 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10406 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

10406 

A 

1 

7 

29 

-0.10 

0.40 

5.59 

-0.48 

10406 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10406 

C 

0 

5 

21 

0.53 

0.59 

0.97 

-0.14 

10406 

D 

0 

12 

50 

1.66 

0.35 

2.51 

0.55 

10407 

* 

-1 

1871 

99 

1.54 

0.03 

0.00 

0.07 

10407 

A 

-1 

23 

100 

0.67 

0.23 

0.00 

0.00 

10407 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10407 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10407 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

10408 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10408 

A 

1 

23 

96 

1.80 

0.35 

1.12 

0.14 

10408 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10408 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10408 

D 

0 

1 

4 

0.68 

0.00 

1.12 

-0.14 

10409 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10409 

A 

1 

22 

92 

1.74 

0.34 

0.80 

0.44 

10409 

B 

0 

1 

4 

-0.96 

0.00 

0.22 

-0.31 

10409 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10409 

D 

0 

1 

4 

-0.85 

0.00 

0.24 

-0.30 

10410 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.04 

10410 

A 

1 

8 

40 

2.78 

0.71 

0.74 

0.69 

10410 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10410 

C 

0 

9 

45 

0.37 

0.31 

0.91 

-0.29 

10410 

D 

0 

3 

15 

-1.61 

0.55 

0.11 

-0.54 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10411 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.05 

10411 

A 

1 

11 

48 

3.13 

0.38 

0.78 

0.68 

10411 

B 

0 

2 

9 

2.07 

0.58 

1.32 

-0.02 

10411 

C 

0 

3 

13 

0.10 

0.31 

0.17 

-0.57 

10411 

D 

0 

7 

30 

1.50 

0.08 

0.65 

-0.31 

10412 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10412 

A 

1 

16 

70 

1.44 

0.34 

1.32 

0.15 

10412 

B 

0 

2 

9 

1.14 

0.65 

1.39 

-0.04 

10412 

C 

0 

3 

13 

1.90 

0.70 

3.91 

0.17 

10412 

D 

0 

2 

9 

-0.46 

0.48 

0.26 

-0.42 

10413 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

0.00 

10413 

A 

1 

16 

67 

2.16 

0.43 

1.03 

0.49 

10413 

B 

0 

3 

13 

0.27 

0.86 

0.90 

-0.28 

10413 

C 

0 

2 

8 

-0.35 

0.17 

0.27 

-0.34 

10413 

D 

0 

3 

13 

0.92 

0.59 

1.33 

-0.14 

10414 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10414 

A 

1 

19 

79 

1.50 

0.39 

1.24 

0.30 

10414 

B 

0 

1 

4 

-0.54 

0.00 

0.32 

-0.23 

10414 

C 

0 

2 

8 

-0.21 

0.53 

0.52 

-0.27 

10414 

D 

0 

2 

8 

1.28 

0.02 

2.00 

0.00 

10415 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10415 

A 

1 

14 

61 

1.98 

0.51 

1.07 

0.56 

10415 

B 

0 

2 

9 

-0.66 

0.71 

0.34 

-0.31 

10415 

C 

0 

7 

30 

0.05 

0.25 

0.68 

-0.41 

10415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10416 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10416 

A 

1 

19 

86 

1.49 

0.42 

1.16 

0.22 

10416 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10416 

C 

0 

3 

14 

0.41 

0.63 

1.34 

-0.22 

10416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10417 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10417 

A 

1 

16 

70 

1.80 

0.31 

0.97 

0.45 

10417 

B 

0 

5 

22 

-0.34 

0.33 

0.34 

-0.60 

10417 

C 

0 

2 

9 

2.04 

1.93 

10.10 

0.14 

10417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10418 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10418 

A 

1 

22 

96 

1.50 

0.30 

0.86 

0.36 

10418 

B 

0 

1 

4 

-1.11 

0.00 

0.18 

-0.36 

10418 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10419 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.04 

10419 

A 

1 

23 

92 

1.09 

0.29 

1.08 

0.08 

10419 

B 

0 

2 

8 

0.68 

1.66 

3.76 

-0.08 

10419 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10420 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.02 

10420 

A 

1 

9 

38 

2.68 

0.67 

1.33 

0.59 

10420 

B 

0 

4 

17 

0.08 

0.15 

0.35 

-0.28 

10420 

C 

0 

8 

33 

0.96 

0.49 

1.77 

-0.11 

10420 

D 

0 

3 

13 

-0.73 

0.55 

0.19 

-0.40 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10421 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

0.00 

10421 

A 

1 

21 

91 

1.76 

0.39 

0.79 

0.40 

10421 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10421 

C 

0 

1 

4 

0.00 

0.00 

0.65 

-0.18 

10421 

D 

0 

1 

4 

-1.72 

0.00 

0.12 

-0.37 

10422 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

10422 

A 

1 

21 

91 

1.02 

0.25 

1.09 

0.06 

10422 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10422 

C 

0 

2 

9 

0.80 

0.21 

1.21 

-0.06 

10422 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10423 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

0.00 

10423 

A 

1 

17 

77 

2.05 

0.37 

0.72 

0.57 

10423 

B 

0 

3 

14 

0.21 

0.56 

0.71 

-0.32 

10423 

C 

0 

2 

9 

-0.89 

0.30 

0.19 

-0.46 

10423 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10424 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10424 

A 

1 

18 

75 

1.72 

0.33 

0.80 

0.58 

10424 

B 

0 

1 

4 

0.00 

0.00 

0.50 

-0.16 

10424 

C 

0 

3 

13 

0.14 

0.30 

0.62 

-0.26 

10424 

D 

0 

2 

8 

-1.32 

0.78 

0.18 

-0.49 

10425 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10425 

A 

1 

18 

75 

1.66 

0.40 

0.80 

0.48 

10425 

B 

0 

1 

4 

1.03 

0.00 

1.68 

-0.02 

10425 

C 

0 

2 

8 

-0.41 

1.17 

0.70 

-0.28 

10425 

D 

0 

3 

13 

-0.62 

0.72 

0.54 

-0.39 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10426 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

10426 

A 

1 

13 

59 

2.09 

0.37 

0.78 

0.58 

10426 

B 

0 

5 

23 

0.83 

0.49 

1.11 

-0.15 

10426 

C 

0 

2 

9 

0.52 

0.01 

0.52 

-0.15 

10426 

D 

0 

2 

9 

-2.00 

1.21 

0.08 

-0.63 

10427 

* 

-1 

1872 

99 

1.54 

0.03 

0.00 

0.10 

10427 

A 

1 

9 

41 

0.69 

0.33 

0.98 

0.41 

10427 

B 

0 

3 

14 

-0.45 

0.51 

0.64 

-0.28 

10427 

C 

0 

6 

27 

-0.08 

0.41 

1.09 

-0.20 

10427 

D 

0 

4 

18 

0.12 

0.35 

1.02 

-0.05 

10428 

* 

-1 

1870 

99 

1.54 

0.03 

0.00 

0.07 

10428 

A 

1 

13 

54 

0.82 

0.33 

1.59 

0.17 

10428 

B 

0 

7 

29 

0.45 

0.32 

1.04 

-0.13 

10428 

C 

0 

2 

8 

0.82 

0.27 

1.25 

0.05 

10428 

D 

0 

2 

8 

0.17 

1.02 

0.98 

-0.14 

10429 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

10429 

A 

1 

21 

91 

1.38 

0.30 

1.27 

0.04 

10429 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10429 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10429 

D 

0 

2 

9 

1.20 

1.79 

5.39 

-0.04 

10430 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

10430 

A 

1 

22 

96 

1.33 

0.25 

1.05 

0.22 

10430 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10430 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10430 

D 

0 

1 

4 

0.12 

0.00 

0.59 

-0.22 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10431 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10431 

A 

1 

20 

91 

1.16 

0.32 

1.07 

0.54 

10431 

B 

0 

1 

5 

0.46 

0.00 

1.04 

-0.04 

10431 

C 

0 

1 

5 

-5.21 

0.00 

0.00 

-0.70 

10431 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10432 

* 

-1 

1723 

91 

1.50 

0.03 

0.00 

-0.05 

10432 

A 

1 

144 

84 

1.90 

0.10 

1.08 

0.26 

10432 

B 

0 

10 

6 

0.90 

0.31 

0.94 

-0.18 

10432 

C 

0 

14 

8 

1.36 

0.25 

1.65 

-0.10 

10432 

D 

0 

3 

2 

-0.02 

0.31 

0.29 

-0.20 

10433 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

10433 

A 

1 

12 

52 

2.43 

0.50 

1.35 

0.50 

10433 

B 

0 

7 

30 

0.26 

0.43 

0.79 

-0.42 

10433 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10433 

D 

0 

4 

17 

0.86 

1.35 

5.00 

-0.15 

10434 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

10434 

A 

1 

14 

64 

1.79 

0.44 

0.99 

0.45 

10434 

B 

0 

1 

5 

-0.56 

0.00 

0.27 

-0.25 

10434 

C 

0 

2 

9 

0.03 

0.00 

0.48 

-0.25 

10434 

D 

0 

5 

23 

0.61 

0.55 

1.71 

-0.22 

10435 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.04 

10435 

A 

1 

10 

42 

2.56 

0.50 

1.34 

0.39 

10435 

B 

0 

6 

25 

0.97 

0.23 

0.44 

-0.43 

10435 

C 

0 

8 

33 

1.95 

0.37 

1.72 

-0.01 

10435 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10436 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10436 

A 

1 

14 

58 

2.14 

0.32 

0.69 

0.60 

10436 

B 

0 

1 

4 

1.46 

0.00 

1.34 

0.01 

10436 

C 

0 

7 

29 

0.16 

0.65 

1.24 

-0.48 

10436 

D 

0 

2 

8 

-0.13 

0.68 

0.34 

-0.28 

10437 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10437 

A 

1 

18 

82 

1.28 

0.42 

1.09 

0.51 

10437 

B 

0 

1 

5 

-1.85 

0.00 

0.17 

-0.31 

10437 

C 

0 

1 

5 

-0.40 

0.00 

0.71 

-0.14 

10437 

D 

0 

2 

9 

-1.27 

0.32 

0.32 

-0.36 

10438 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

10438 

A 

1 

22 

92 

1.28 

0.24 

0.81 

0.50 

10438 

B 

0 

2 

8 

-0.94 

0.01 

0.22 

-0.50 

10438 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10438 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10439 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.03 

10439 

A 

1 

18 

72 

1.48 

0.40 

0.97 

0.38 

10439 

B 

0 

3 

12 

0.13 

0.54 

0.86 

-0.23 

10439 

C 

0 

2 

8 

0.05 

1.12 

1.02 

-0.20 

10439 

D 

0 

2 

8 

0.29 

0.20 

0.77 

-0.15 

10440 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10440 

A 

1 

15 

68 

1.47 

0.46 

1.01 

0.46 

10440 

B 

0 

3 

14 

0.12 

0.13 

0.74 

-0.18 

10440 

C 

0 

1 

5 

0.35 

0.00 

0.91 

-0.07 

10440 

D 

0 

3 

14 

-0.86 

1.18 

0.60 

-0.40 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10441 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

10441 

A 

1 

18 

78 

1.74 

0.40 

1.73 

0.54 

10441 

B 

0 

2 

9 

1.36 

1.03 

3.55 

0.04 

10441 

C 

0 

1 

4 

-0.45 

0.00 

0.37 

-0.14 

10441 

D 

0 

2 

9 

-4.22 

1.01 

0.02 

-0.72 

10442 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.02 

10442 

A 

1 

13 

59 

2.49 

0.54 

1.44 

0.46 

10442 

B 

0 

2 

9 

1.01 

0.84 

1.11 

-0.14 

10442 

C 

0 

6 

27 

0.79 

0.50 

1.30 

-0.36 

10442 

D 

0 

1 

5 

0.90 

0.00 

0.72 

-0.11 

10443 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

10443 

A 

1 

10 

45 

2.21 

0.47 

1.01 

0.52 

10443 

B 

0 

3 

14 

0.42 

0.78 

0.73 

-0.26 

10443 

C 

0 

8 

36 

0.71 

0.43 

0.90 

-0.34 

10443 

D 

0 

1 

5 

1.17 

0.00 

0.87 

-0.03 

10444 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

10444 

A 

1 

15 

68 

1.24 

0.25 

0.86 

0.51 

10444 

B 

0 

1 

5 

0.50 

0.00 

0.79 

-0.09 

10444 

C 

0 

3 

14 

0.18 

0.60 

0.76 

-0.29 

10444 

D 

0 

3 

14 

0.00 

0.43 

0.58 

-0.36 

10445 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

0.00 

10445 

A 

1 

18 

86 

1.70 

0.43 

0.99 

0.20 

10445 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10445 

C 

0 

2 

10 

0.83 

1.83 

4.08 

-0.13 

10445 

D 

0 

1 

5 

0.32 

0.00 

0.77 

-0.15 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10446 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10446 

A 

1 

19 

83 

2.07 

0.30 

0.65 

0.62 

10446 

B 

0 

3 

13 

-0.33 

0.73 

0.41 

-0.49 

10446 

C 

0 

1 

4 

-0.73 

0.00 

0.19 

-0.33 

10446 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10447 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.03 

10447 

A 

1 

13 

59 

2.89 

0.46 

0.65 

0.67 

10447 

B 

0 

2 

9 

0.47 

0.92 

0.64 

-0.25 

10447 

C 

0 

5 

23 

0.59 

0.52 

0.76 

-0.39 

10447 

D 

0 

2 

9 

0.02 

0.21 

0.28 

-0.33 

10448 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

10448 

A 

1 

19 

83 

2.20 

0.40 

0.65 

0.58 

10448 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10448 

C 

0 

1 

4 

0.44 

0.00 

0.74 

-0.13 

10448 

D 

0 

3 

13 

-1.40 

1.25 

0.33 

-0.57 

10449 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

10449 

A 

1 

16 

67 

1.93 

0.42 

1.16 

0.42 

10449 

B 

0 

6 

25 

0.50 

0.24 

0.76 

-0.33 

10449 

C 

0 

2 

8 

0.37 

2.10 

2.39 

-0.20 

10449 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10450 

* 

-1 

1870 

99 

1.52 

0.03 

0.00 

-0.02 

10450 

A 

1 

20 

83 

2.02 

0.29 

0.94 

0.44 

10450 

B 

0 

1 

4 

0.48 

0.00 

0.49 

-0.20 

10450 

C 

0 

3 

13 

0.47 

0.50 

0.61 

-0.37 

10450 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30006 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.02 

30006 

A 

1 

7 

41 

1.39 

0.53 

2.20 

0.12 

30006 

B 

0 

1 

6 

2.39 

0.00 

2.82 

0.25 

30006 

C 

0 

6 

35 

1.11 

0.48 

1.23 

-0.08 

30006 

D 

0 

3 

18 

0.70 

0.57 

0.74 

-0.21 

30011 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.05 

30011 

A 

1 

10 

48 

1.13 

0.39 

1.38 

0.24 

30011 

B 

0 

4 

19 

0.38 

0.50 

0.97 

-0.25 

30011 

C 

0 

2 

10 

-0.05 

0.02 

0.43 

-0.30 

30011 

D 

0 

5 

24 

1.17 

0.14 

1.51 

0.16 

30104 

* 

-1 

1879 

99 

1.53 

0.03 

0.00 

0.01 

30104 

A 

1 

6 

40 

1.88 

0.85 

1.61 

0.26 

30104 

B 

0 

2 

13 

1.57 

0.60 

1.63 

0.05 

30104 

C 

0 

3 

20 

1.31 

0.88 

2.33 

-0.01 

30104 

D 

0 

4 

27 

0.40 

1.05 

1.41 

-0.32 

30105 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.01 

30105 

A 

1 

18 

72 

1.96 

0.34 

0.68 

0.56 

30105 

B 

0 

2 

8 

-0.38 

0.30 

0.31 

-0.31 

30105 

C 

0 

2 

8 

1.72 

0.69 

3.03 

0.06 

30105 

D 

0 

3 

12 

-1.14 

0.60 

0.18 

-0.56 

30106 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

30106 

A 

1 

21 

91 

1.67 

0.31 

0.40 

0.69 

30106 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30106 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30106 

D 

0 

2 

9 

-2.85 

0.36 

0.07 

-0.69 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30108 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.01 

30108 

A 

1 

21 

88 

1.65 

0.23 

0.74 

0.48 

30108 

B 

0 

1 

4 

1.54 

0.00 

1.85 

0.02 

30108 

C 

0 

1 

4 

0.44 

0.00 

0.61 

-0.16 

30108 

D 

0 

1 

4 

-2.69 

0.00 

0.03 

-0.65 

30110 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.03 

30110 

A 

1 

18 

90 

1.31 

0.36 

0.93 

0.33 

30110 

B 

0 

1 

5 

-0.20 

0.00 

0.50 

-0.21 

30110 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30110 

D 

0 

1 

5 

-0.44 

0.00 

0.40 

-0.24 

30111 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

30111 

A 

1 

19 

86 

1.68 

0.30 

0.92 

0.45 

30111 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30111 

C 

0 

1 

5 

-0.45 

0.00 

0.28 

-0.30 

30111 

D 

0 

2 

9 

0.07 

0.71 

0.59 

-0.32 

30112 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

30112 

A 

1 

20 

87 

1.68 

0.25 

0.77 

0.53 

30112 

B 

0 

3 

13 

-0.32 

0.70 

0.51 

-0.53 

30112 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30114 

* 

-1 

1728 

91 

1.52 

0.03 

0.00 

-0.02 

30114 

A 

1 

128 

77 

1.80 

0.10 

1.00 

0.31 

30114 

B 

0 

8 

5 

0.00 

0.43 

0.48 

-0.30 

30114 

C 

0 

28 

17 

1.27 

0.22 

2.10 

-0.12 

30114 

D 

0 

2 

1 

-0.37 

0.29 

0.20 

-0.18 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30115 

* 

-1 

1877 

99 

1.52 

0.03 

0.00 

-0.01 

30115 

A 

-1 

17 

100 

1.70 

0.30 

0.00 

0.00 

30115 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30115 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30115 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30116 

* 

-1 

1875 

99 

1.52 

0.03 

0.00 

-0.01 

30116 

A 

1 

17 

89 

1.74 

0.37 

1.16 

0.06 

30116 

B 

0 

1 

5 

1.21 

0.00 

1.10 

-0.09 

30116 

C 

0 

1 

5 

1.77 

0.00 

1.94 

0.01 

30116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30117 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

30117 

A 

1 

18 

75 

1.12 

0.31 

1.22 

0.29 

30117 

B 

0 

2 

8 

0.69 

0.22 

1.14 

-0.06 

30117 

C 

0 

2 

8 

-0.16 

0.78 

0.63 

-0.27 

30117 

D 

0 

2 

8 

0.38 

0.52 

0.93 

-0.13 

30118 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

-0.01 

30118 

A 

1 

17 

81 

2.01 

0.44 

0.85 

0.47 

30118 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30118 

C 

0 

2 

10 

-0.35 

0.21 

0.37 

-0.35 

30118 

D 

0 

2 

10 

0.07 

0.26 

0.57 

-0.28 

30123 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.01 

30123 

A 

1 

15 

71 

1.38 

0.41 

1.68 

0.04 

30123 

B 

0 

1 

5 

0.50 

0.00 

0.60 

-0.14 

30123 

C 

0 

5 

24 

1.43 

0.31 

1.88 

0.03 

30123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30124 

* 

-1 

1875 

99 

1.52 

0.03 

0.00 

0.00 

30124 

A 

1 

15 

79 

1.86 

0.37 

1.15 

0.41 

30124 

B 

0 

3 

16 

0.76 

0.74 

1.18 

-0.24 

30124 

C 

0 

1 

5 

-0.58 

0.00 

0.21 

-0.35 

30124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30125 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

30125 

A 

1 

19 

86 

1.34 

0.43 

1.06 

0.49 

30125 

B 

0 

1 

5 

-0.45 

0.00 

0.50 

-0.14 

30125 

C 

0 

1 

5 

0.30 

0.00 

1.05 

-0.06 

30125 

D 

0 

1 

5 

-5.24 

0.00 

0.00 

-0.61 

30126 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.01 

30126 

A 

1 

7 

30 

3.45 

0.55 

0.52 

0.72 

30126 

B 

0 

3 

13 

0.88 

0.56 

0.65 

-0.10 

30126 

C 

0 

8 

35 

0.97 

0.39 

0.86 

-0.15 

30126 

D 

0 

5 

22 

-0.59 

0.68 

0.29 

-0.54 

30129 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

30129 

A 

1 

10 

45 

2.12 

0.50 

1.14 

0.48 

30129 

B 

0 

7 

32 

0.55 

0.54 

2.15 

-0.29 

30129 

C 

0 

4 

18 

0.47 

1.00 

1.97 

-0.22 

30129 

D 

0 

1 

5 

0.49 

0.00 

0.52 

-0.10 

30134 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.01 

30134 

A 

-1 

21 

95 

1.66 

0.24 

0.00 

0.81 

30134 

B 

-1 

1 

5 

-5.21 

0.00 

0.00 

-0.81 

30134 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30134 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30135 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.03 

30135 

A 

1 

24 

96 

1.23 

0.38 

1.05 

0.11 

30135 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30135 

C 

0 

1 

4 

0.26 

0.00 

1.06 

-0.11 

30135 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30148 

* 

-1 

1879 

99 

1.52 

0.03 

0.00 

0.00 

30148 

A 

1 

11 

73 

1.94 

0.48 

1.14 

0.37 

30148 

B 

0 

1 

7 

-1.26 

0.00 

0.10 

-0.47 

30148 

C 

0 

2 

13 

1.96 

0.47 

2.72 

0.09 

30148 

D 

0 

1 

7 

-0.26 

0.00 

0.27 

-0.31 

30149 

* 

-1 

1868 

99 

1.52 

0.03 

0.00 

-0.01 

30149 

A 

1 

13 

50 

2.48 

0.29 

0.74 

0.61 

30149 

B 

0 

8 

31 

0.28 

0.48 

0.54 

-0.64 

30149 

C 

0 

3 

12 

1.83 

0.33 

1.31 

0.05 

30149 

D 

0 

2 

8 

1.21 

0.11 

0.63 

-0.09 

30251 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

-0.02 

30251 

A 

1 

20 

95 

1.98 

0.36 

0.83 

0.38 

30251 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30251 

C 

0 

1 

5 

-0.97 

0.00 

0.19 

-0.38 

30251 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30253 

* 

-1 

1880 

99 

1.52 

0.03 

0.00 

-0.07 

30253 

A 

-1 

14 

100 

2.66 

0.36 

0.00 

0.00 

30253 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30253 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30253 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30256 

* 

-1 

1864 

98 

1.54 

0.03 

0.00 

0.06 

30256 

A 

1 

24 

80 

1.29 

0.26 

0.67 

0.61 

30256 

B 

0 

1 

3 

0.33 

0.00 

1.09 

-0.06 

30256 

C 

0 

3 

10 

-0.79 

0.28 

0.39 

-0.37 

30256 

D 

0 

2 

7 

-1.88 

0.16 

0.12 

-0.49 

30257 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.00 

30257 

A 

1 

12 

71 

1.89 

0.48 

1.40 

0.43 

30257 

B 

0 

4 

24 

0.54 

0.45 

0.97 

-0.34 

30257 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30257 

D 

0 

1 

6 

0.17 

0.00 

0.48 

-0.21 

30258 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

30258 

A 

1 

16 

73 

1.71 

0.39 

1.08 

0.48 

30258 

B 

0 

1 

5 

0.88 

0.00 

1.15 

-0.05 

30258 

C 

0 

4 

18 

-0.25 

0.63 

0.65 

-0.45 

30258 

D 

0 

1 

5 

0.17 

0.00 

0.57 

-0.15 

30259 

* 

-1 

1868 

99 

1.53 

0.03 

0.00 

0.02 

30259 

A 

1 

21 

81 

1.79 

0.42 

0.83 

0.50 

30259 

B 

0 

1 

4 

-0.46 

0.00 

0.46 

-0.18 

30259 

C 

0 

3 

12 

-0.46 

0.19 

0.48 

-0.32 

30259 

D 

0 

1 

4 

-1.78 

0.00 

0.12 

-0.31 

30261 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

30261 

A 

1 

20 

91 

1.11 

0.29 

0.74 

0.57 

30261 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30261 

C 

0 

1 

5 

-1.07 

0.00 

0.35 

-0.28 

30261 

D 

0 

1 

5 

-2.69 

0.00 

0.07 

-0.51 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30265 

* 

-1 

1878 

99 

1.53 

0.03 

0.00 

0.04 

30265 

A 

1 

15 

94 

1.01 

0.27 

1.04 

0.25 

30265 

B 

0 

1 

6 

-0.05 

0.00 

0.56 

-0.25 

30265 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30265 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30266 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

30266 

A 

1 

19 

83 

1.78 

0.38 

0.92 

0.40 

30266 

B 

0 

2 

9 

-0.12 

1.10 

0.70 

-0.30 

30266 

C 

0 

1 

4 

0.53 

0.00 

0.80 

-0.12 

30266 

D 

0 

1 

4 

-0.25 

0.00 

0.37 

-0.22 

30267 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.01 

30267 

A 

-1 

20 

100 

1.41 

0.43 

0.00 

0.00 

30267 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30267 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30267 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30268 

* 

-1 

1879 

99 

1.53 

0.03 

0.00 

0.06 

30268 

A 

1 

12 

80 

0.82 

0.44 

1.12 

0.31 

30268 

B 

0 

1 

7 

0.61 

0.00 

1.69 

0.00 

30268 

C 

0 

1 

7 

-0.54 

0.00 

0.53 

-0.22 

30268 

D 

0 

1 

7 

-0.92 

0.00 

0.37 

-0.29 

30269 

* 

-1 

1867 

99 

1.52 

0.03 

0.00 

0.00 

30269 

A 

1 

23 

85 

1.78 

0.35 

1.39 

0.35 

30269 

B 

0 

1 

4 

1.24 

0.00 

1.80 

-0.03 

30269 

C 

0 

1 

4 

1.23 

0.00 

1.77 

-0.04 

30269 

D 

0 

2 

7 

-0.98 

0.79 

0.26 

-0.42 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30271 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.01 

30271 

A 

1 

24 

96 

1.45 

0.34 

0.91 

0.31 

30271 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30271 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30271 

D 

0 

1 

4 

-1.20 

0.00 

0.22 

-0.31 

30275 

* 

-1 

1257 

66 

1.65 

0.04 

0.00 

0.12 

30275 

A 

1 

239 

38 

2.35 

0.10 

1.26 

0.51 

30275 

B 

0 

114 

18 

0.65 

0.10 

0.83 

-0.18 

30275 

C 

0 

173 

27 

0.77 

0.10 

1.15 

-0.20 

30275 

D 

0 

111 

17 

0.46 

0.14 

0.97 

-0.24 

30308 

* 

-1 

1258 

66 

1.65 

0.04 

0.00 

0.12 

30308 

A 

1 

391 

61 

1.96 

0.07 

1.04 

0.53 

30308 

B 

0 

147 

23 

0.53 

0.09 

1.15 

-0.26 

30308 

C 

0 

66 

10 

-0.04 

0.11 

0.53 

-0.28 

30308 

D 

0 

32 

5 

-0.74 

0.31 

0.45 

-0.29 

30401 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.03 

30401 

A 

1 

15 

75 

1.99 

0.39 

0.76 

0.61 

30401 

B 

0 

1 

5 

0.60 

0.00 

0.87 

-0.05 

30401 

C 

0 

1 

5 

2.52 

0.00 

5.91 

0.13 

30401 

D 

0 

3 

15 

-3.22 

1.16 

0.08 

-0.78 

30402 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

30402 

A 

1 

21 

91 

1.11 

0.31 

1.05 

0.08 

30402 

B 

0 

1 

4 

-0.70 

0.00 

0.32 

-0.27 

30402 

C 

0 

1 

4 

2.14 

0.00 

5.54 

0.16 

30402 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30403 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.02 

30403 

A 

1 

19 

95 

1.30 

0.28 

0.97 

0.30 

30403 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30403 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30403 

D 

0 

1 

5 

-0.33 

0.00 

0.37 

-0.30 

30404 

* 

-1 

1861 

98 

1.52 

0.03 

0.00 

-0.02 

30404 

A 

1 

31 

94 

1.89 

0.27 

0.91 

0.35 

30404 

B 

0 

1 

3 

-0.66 

0.00 

0.22 

-0.27 

30404 

C 

0 

1 

3 

-0.17 

0.00 

0.37 

-0.22 

30404 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30405 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.02 

30405 

A 

1 

12 

60 

2.07 

0.49 

1.00 

0.51 

30405 

B 

0 

4 

20 

0.08 

0.38 

0.51 

-0.33 

30405 

C 

0 

3 

15 

1.14 

1.03 

3.23 

-0.04 

30405 

D 

0 

1 

5 

-2.49 

0.00 

0.03 

-0.47 

30406 

* 

-1 

1862 

98 

1.53 

0.03 

0.00 

0.01 

30406 

A 

1 

26 

81 

1.83 

0.30 

0.87 

0.47 

30406 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30406 

C 

0 

2 

6 

0.01 

0.12 

0.48 

-0.22 

30406 

D 

0 

4 

13 

-0.33 

1.00 

0.76 

-0.40 

30410 

* 

-1 

1882 

99 

1.53 

0.03 

0.00 

0.04 

30410 

A 

1 

9 

75 

1.05 

0.26 

0.93 

0.30 

30410 

B 

0 

1 

8 

1.79 

0.00 

2.86 

0.32 

30410 

C 

0 

2 

17 

-0.20 

0.24 

0.41 

-0.59 

30410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS First Grade Math Measure Development 


288 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30413 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.03 

30413 

A 

1 

17 

71 

1.63 

0.33 

1.16 

0.44 

30413 

B 

0 

1 

4 

2.25 

0.00 

3.40 

0.13 

30413 

C 

0 

3 

13 

0.57 

0.18 

0.66 

-0.12 

30413 

D 

0 

3 

13 

-1.55 

1.86 

0.52 

-0.56 

30416 

* 

-1 

1859 

98 

1.53 

0.03 

0.00 

0.04 

30416 

A 

1 

29 

83 

1.32 

0.22 

1.11 

0.29 

30416 

B 

0 

1 

3 

0.04 

0.00 

0.48 

-0.17 

30416 

C 

0 

4 

11 

0.47 

0.36 

0.89 

-0.22 

30416 

D 

0 

1 

3 

0.62 

0.00 

0.87 

-0.08 

30417 

* 

-1 

1866 

99 

1.53 

0.03 

0.00 

0.01 

30417 

A 

1 

16 

57 

2.40 

0.39 

0.81 

0.57 

30417 

B 

0 

10 

36 

0.65 

0.40 

1.41 

-0.32 

30417 

C 

0 

1 

4 

-0.03 

0.00 

0.33 

-0.15 

30417 

D 

0 

1 

4 

-3.76 

0.00 

0.01 

-0.53 

30419 

* 

-1 

1869 

99 

1.52 

0.03 

0.00 

0.00 

30419 

A 

1 

21 

84 

2.01 

0.26 

0.60 

0.70 

30419 

B 

0 

2 

8 

-1.04 

0.65 

0.19 

-0.50 

30419 

C 

0 

2 

8 

-0.75 

0.21 

0.21 

-0.45 

30419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30421 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.00 

30421 

A 

1 

20 

83 

1.85 

0.40 

0.86 

0.47 

30421 

B 

0 

1 

4 

0.27 

0.00 

0.80 

-0.14 

30421 

C 

0 

2 

8 

-0.57 

0.17 

0.35 

-0.34 

30421 

D 

0 

1 

4 

-0.92 

0.00 

0.24 

-0.27 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30422 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.05 

30422 

A 

1 

18 

72 

1.16 

0.36 

1.10 

0.30 

30422 

B 

0 

4 

16 

0.33 

1.15 

3.41 

-0.15 

30422 

C 

0 

1 

4 

-0.45 

0.00 

0.45 

-0.17 

30422 

D 

0 

2 

8 

-0.02 

0.15 

0.69 

-0.17 

30424 

* 

-1 

1860 

98 

1.53 

0.03 

0.00 

0.04 

30424 

A 

1 

23 

68 

1.39 

0.21 

0.97 

0.39 

30424 

B 

0 

4 

12 

0.40 

0.48 

0.84 

-0.24 

30424 

C 

0 

5 

15 

0.60 

0.57 

1.48 

-0.19 

30424 

D 

0 

2 

6 

0.37 

1.01 

0.90 

-0.17 

30457 

* 

-1 

1867 

99 

1.52 

0.03 

0.00 

0.00 

30457 

A 

1 

24 

89 

1.64 

0.29 

1.14 

0.19 

30457 

B 

0 

1 

4 

1.42 

0.00 

1.73 

-0.02 

30457 

C 

0 

1 

4 

0.37 

0.00 

0.61 

-0.17 

30457 

D 

0 

1 

4 

0.68 

0.00 

0.83 

-0.13 

30458 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.05 

30458 

A 

1 

17 

81 

1.11 

0.41 

1.51 

0.25 

30458 

B 

0 

3 

14 

-0.40 

1.06 

1.05 

-0.32 

30458 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30458 

D 

0 

1 

5 

1.50 

0.00 

3.45 

0.08 

30459 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.01 

30459 

A 

1 

10 

40 

2.57 

0.39 

0.59 

0.65 

30459 

B 

0 

2 

8 

1.94 

0.43 

1.83 

0.11 

30459 

C 

0 

5 

20 

0.03 

0.53 

0.38 

-0.43 

30459 

D 

0 

8 

32 

0.53 

0.41 

0.69 

-0.37 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30511 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.03 

30511 

A 

1 

15 

79 

1.36 

0.39 

1.02 

0.37 

30511 

B 

0 

2 

11 

0.78 

0.67 

1.61 

-0.07 

30511 

C 

0 

2 

11 

-0.75 

0.19 

0.29 

-0.42 

30511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30512 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.05 

30512 

A 

1 

14 

82 

1.02 

0.25 

0.88 

0.53 

30512 

B 

0 

2 

12 

-0.38 

0.55 

0.48 

-0.43 

30512 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30512 

D 

0 

1 

6 

-0.26 

0.00 

0.47 

-0.27 

30513 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.02 

30513 

A 

1 

13 

68 

1.79 

0.62 

1.84 

0.36 

30513 

B 

0 

1 

5 

-1.07 

0.00 

0.20 

-0.29 

30513 

C 

0 

1 

5 

0.46 

0.00 

0.93 

-0.10 

30513 

D 

0 

4 

21 

0.57 

0.38 

1.29 

-0.20 

30514 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.04 

30514 

A 

1 

16 

76 

1.35 

0.47 

1.00 

0.37 

30514 

B 

0 

1 

5 

2.16 

0.00 

7.34 

0.14 

30514 

C 

0 

1 

5 

-1.58 

0.00 

0.18 

-0.29 

30514 

D 

0 

3 

14 

-0.80 

1.20 

0.86 

-0.36 

30515 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.04 

30515 

A 

1 

14 

70 

1.24 

0.39 

1.16 

0.30 

30515 

B 

0 

1 

5 

-1.26 

0.00 

0.17 

-0.38 

30515 

C 

0 

4 

20 

0.82 

0.33 

1.55 

-0.06 

30515 

D 

0 

1 

5 

0.10 

0.00 

0.64 

-0.15 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30517 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.00 

30517 

A 

1 

12 

67 

1.80 

0.45 

1.47 

0.31 

30517 

B 

0 

1 

6 

-0.87 

0.00 

0.14 

-0.37 

30517 

C 

0 

1 

6 

-0.09 

0.00 

0.31 

-0.25 

30517 

D 

0 

4 

22 

1.45 

0.68 

2.73 

-0.01 

30518 

* 

-1 

1862 

98 

1.54 

0.03 

0.00 

0.07 

30518 

A 

1 

28 

88 

0.96 

0.26 

0.97 

0.30 

30518 

B 

0 

1 

3 

1.07 

0.00 

2.30 

0.03 

30518 

C 

0 

1 

3 

-1.38 

0.00 

0.20 

-0.28 

30518 

D 

0 

2 

6 

-0.48 

0.19 

0.50 

-0.24 

30519 

* 

-1 

1879 

99 

1.52 

0.03 

0.00 

-0.01 

30519 

A 

1 

9 

60 

2.51 

0.55 

0.85 

0.65 

30519 

B 

0 

4 

27 

0.28 

0.56 

0.64 

-0.47 

30519 

C 

0 

1 

7 

-0.11 

0.00 

0.28 

-0.27 

30519 

D 

0 

1 

7 

0.55 

0.00 

0.54 

-0.17 

30520 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.06 

30520 

A 

1 

15 

71 

0.81 

0.36 

1.43 

0.13 

30520 

B 

0 

1 

5 

-0.33 

0.00 

0.47 

-0.19 

30520 

C 

0 

1 

5 

0.21 

0.00 

0.81 

-0.09 

30520 

D 

0 

4 

19 

0.72 

0.43 

1.81 

0.00 

30555 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.01 

30555 

A 

1 

12 

67 

1.70 

0.49 

1.25 

0.25 

30555 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30555 

C 

0 

5 

28 

0.84 

0.69 

1.77 

-0.23 

30555 

D 

0 

1 

6 

1.07 

0.00 

1.17 

-0.06 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30557 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

30557 

A 

1 

19 

83 

1.77 

0.31 

0.86 

0.43 

30557 

B 

0 

3 

13 

0.43 

0.69 

1.00 

-0.29 

30557 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30557 

D 

0 

1 

4 

-0.59 

0.00 

0.22 

-0.31 

30559 

* 

-1 

1879 

99 

1.53 

0.03 

0.00 

0.01 

30559 

A 

1 

14 

93 

1.37 

0.42 

1.13 

-0.08 

30559 

B 

0 

1 

7 

1.84 

0.00 

3.20 

0.08 

30559 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30559 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30560 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.06 

30560 

A 

1 

16 

80 

1.22 

0.45 

1.39 

0.51 

30560 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30560 

C 

0 

3 

15 

-0.81 

0.38 

0.54 

-0.36 

30560 

D 

0 

1 

5 

-2.04 

0.00 

0.14 

-0.35 

30561 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.03 

30561 

A 

1 

13 

57 

1.83 

0.29 

0.68 

0.71 

30561 

B 

0 

6 

26 

0.08 

0.25 

0.47 

-0.51 

30561 

C 

0 

4 

17 

0.21 

0.21 

0.50 

-0.34 

30561 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30564 

* 

-1 

1880 

99 

1.53 

0.03 

0.00 

0.01 

30564 

A 

1 

9 

64 

1.63 

0.44 

1.43 

0.23 

30564 

B 

0 

1 

7 

0.99 

0.00 

0.76 

-0.11 

30564 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30564 

D 

0 

4 

29 

1.10 

0.56 

1.34 

-0.18 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30579 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

30579 

A 

1 

17 

74 

1.78 

0.39 

1.35 

0.33 

30579 

B 

0 

1 

4 

1.96 

0.00 

2.68 

0.07 

30579 

C 

0 

1 

4 

0.61 

0.00 

0.70 

-0.13 

30579 

D 

0 

4 

17 

0.35 

0.45 

0.67 

-0.35 

30583 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.01 

30583 

A 

1 

16 

84 

1.58 

0.40 

0.98 

0.38 

30583 

B 

0 

1 

5 

0.00 

0.00 

0.51 

-0.20 

30583 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30583 

D 

0 

2 

11 

-0.04 

0.07 

0.49 

-0.31 

30589 

* 

-1 

1867 

99 

1.53 

0.03 

0.00 

0.04 

30589 

A 

1 

21 

78 

1.39 

0.42 

0.98 

0.33 

30589 

B 

0 

1 

4 

0.55 

0.00 

1.40 

-0.05 

30589 

C 

0 

2 

7 

0.35 

0.20 

1.18 

-0.10 

30589 

D 

0 

3 

11 

-0.68 

1.36 

2.09 

-0.32 

30590 

* 

-1 

1881 

99 

1.53 

0.03 

0.00 

0.02 

30590 

A 

-1 

12 

92 

1.75 

0.33 

0.00 

0.87 

30590 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30590 

C 

-1 

1 

8 

-5.21 

0.00 

0.00 

-0.87 

30590 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30591 

* 

-1 

1875 

99 

1.52 

0.03 

0.00 

-0.01 

30591 

A 

1 

17 

89 

1.85 

0.32 

1.01 

0.35 

30591 

B 

0 

2 

11 

0.36 

0.01 

0.46 

-0.35 

30591 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30591 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30594 

* 

-1 

1725 

91 

1.50 

0.03 

0.00 

-0.06 

30594 

A 

1 

161 

95 

1.86 

0.10 

0.98 

0.28 

30594 

B 

0 

2 

1 

-0.44 

0.66 

0.28 

-0.18 

30594 

C 

0 

5 

3 

0.50 

0.37 

0.78 

-0.16 

30594 

D 

0 

1 

1 

-0.91 

0.00 

0.14 

-0.15 

30595 

* 

-1 

1868 

99 

1.53 

0.03 

0.00 

0.02 

30595 

A 

1 

23 

88 

1.49 

0.35 

1.12 

0.33 

30595 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30595 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30595 

D 

0 

3 

12 

-0.20 

0.54 

0.79 

-0.33 

30598 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.02 

30598 

A 

1 

20 

87 

1.85 

0.38 

1.16 

0.15 

30598 

B 

0 

2 

9 

0.97 

1.76 

3.25 

-0.15 

30598 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30598 

D 

0 

1 

4 

1.37 

0.00 

1.61 

-0.05 

30600 

* 

-1 

1874 

99 

1.52 

0.03 

0.00 

-0.01 

30600 

A 

1 

15 

75 

2.12 

0.47 

0.82 

0.47 

30600 

B 

0 

1 

5 

-1.00 

0.00 

0.18 

-0.33 

30600 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30600 

D 

0 

4 

20 

0.40 

0.58 

1.26 

-0.33 

30601 

* 

-1 

1865 

98 

1.53 

0.03 

0.00 

0.02 

30601 

A 

1 

22 

76 

1.86 

0.29 

0.62 

0.61 

30601 

B 

0 

3 

10 

-1.15 

0.21 

0.16 

-0.51 

30601 

C 

0 

3 

10 

-0.72 

0.32 

0.27 

-0.42 

30601 

D 

0 

1 

3 

2.47 

0.00 

5.93 

0.14 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30602 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

30602 

A 

1 

13 

59 

1.67 

0.26 

0.73 

0.59 

30602 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30602 

C 

0 

7 

32 

0.41 

0.42 

1.01 

-0.42 

30602 

D 

0 

2 

9 

-0.03 

0.05 

0.36 

-0.32 

30605 

* 

-1 

1868 

99 

1.52 

0.03 

0.00 

0.00 

30605 

A 

1 

12 

46 

2.57 

0.44 

0.93 

0.59 

30605 

B 

0 

8 

31 

0.46 

0.30 

0.49 

-0.47 

30605 

C 

0 

2 

8 

1.28 

1.82 

2.77 

-0.05 

30605 

D 

0 

4 

15 

0.88 

0.58 

0.84 

-0.18 

30606 

* 

-1 

1878 

99 

1.53 

0.03 

0.00 

0.00 

30606 

A 

1 

10 

63 

2.09 

0.38 

0.77 

0.55 

30606 

B 

0 

1 

6 

0.24 

0.00 

0.34 

-0.24 

30606 

C 

0 

3 

19 

1.02 

0.98 

1.36 

-0.17 

30606 

D 

0 

2 

13 

0.00 

0.26 

0.27 

-0.42 

30608 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.02 

30608 

A 

1 

11 

55 

1.92 

0.39 

1.00 

0.56 

30608 

B 

0 

3 

15 

0.12 

0.40 

0.39 

-0.38 

30608 

C 

0 

3 

15 

0.80 

0.41 

0.79 

-0.16 

30608 

D 

0 

3 

15 

0.54 

0.75 

0.80 

-0.24 

30609 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.03 

30609 

A 

1 

12 

55 

2.17 

0.47 

0.97 

0.64 

30609 

B 

0 

3 

14 

0.18 

0.20 

0.51 

-0.24 

30609 

C 

0 

2 

9 

0.53 

0.07 

0.69 

-0.12 

30609 

D 

0 

5 

23 

-0.32 

0.50 

0.43 

-0.49 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30613 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.03 

30613 

A 

1 

18 

82 

2.14 

0.34 

0.93 

0.32 

30613 

B 

0 

3 

14 

1.10 

1.23 

3.59 

-0.22 

30613 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30613 

D 

0 

1 

5 

0.35 

0.00 

0.42 

-0.23 

30618 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.03 

30618 

A 

1 

9 

47 

1.96 

0.34 

0.95 

0.60 

30618 

B 

0 

4 

21 

0.78 

0.54 

0.90 

-0.16 

30618 

C 

0 

3 

16 

0.66 

0.23 

0.58 

-0.17 

30618 

D 

0 

3 

16 

-0.21 

0.92 

0.40 

-0.47 

30619 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

-0.01 

30619 

A 

1 

13 

57 

2.60 

0.39 

0.67 

0.62 

30619 

B 

0 

2 

9 

1.18 

1.28 

1.57 

-0.07 

30619 

C 

0 

4 

17 

-1.13 

0.26 

0.09 

-0.69 

30619 

D 

0 

4 

17 

1.31 

0.65 

1.67 

-0.07 

30701 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.07 

30701 

A 

1 

18 

86 

0.90 

0.25 

0.88 

0.52 

30701 

B 

0 

1 

5 

-0.97 

0.00 

0.30 

-0.33 

30701 

C 

0 

2 

10 

-0.65 

0.09 

0.41 

-0.38 

30701 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30702 

* 

-1 

1875 

99 

1.52 

0.03 

0.00 

-0.01 

30702 

A 

-1 

19 

100 

1.69 

0.32 

0.00 

0.00 

30702 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30702 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30702 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30703 

* 

-1 

1879 

99 

1.52 

0.03 

0.00 

0.00 

30703 

A 

1 

14 

93 

1.60 

0.41 

1.20 

0.03 

30703 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30703 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30703 

D 

0 

1 

7 

1.41 

0.00 

1.93 

-0.03 

30705 

* 

-1 

1878 

99 

1.53 

0.03 

0.00 

0.04 

30705 

A 

1 

15 

94 

1.00 

0.41 

0.96 

0.30 

30705 

B 

0 

1 

6 

-0.94 

0.00 

0.38 

-0.30 

30705 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30705 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30706 

* 

-1 

1880 

99 

1.52 

0.03 

0.00 

-0.02 

30706 

A 

1 

13 

93 

2.15 

0.45 

0.48 

0.62 

30706 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30706 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30706 

D 

0 

1 

7 

-2.49 

0.00 

0.06 

-0.62 

30707 

* 

-1 

1871 

99 

1.52 

0.03 

0.00 

0.00 

30707 

A 

1 

17 

74 

2.39 

0.38 

0.89 

0.62 

30707 

B 

0 

2 

9 

-2.80 

2.41 

0.22 

-0.62 

30707 

C 

0 

4 

17 

0.34 

0.53 

0.61 

-0.26 

30707 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30708 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.00 

30708 

A 

1 

20 

87 

1.68 

0.45 

1.17 

0.23 

30708 

B 

0 

1 

4 

0.84 

0.00 

1.56 

-0.08 

30708 

C 

0 

2 

9 

0.16 

0.45 

0.87 

-0.22 

30708 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30709 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.02 

30709 

A 

1 

15 

83 

1.53 

0.44 

1.04 

0.31 

30709 

B 

0 

2 

11 

0.27 

1.09 

1.24 

-0.22 

30709 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30709 

D 

0 

1 

6 

0.01 

0.00 

0.58 

-0.19 

30710 

* 

-1 

1863 

98 

1.54 

0.03 

0.00 

0.07 

30710 

A 

1 

21 

68 

1.11 

0.35 

1.52 

0.29 

30710 

B 

0 

6 

19 

-0.41 

0.45 

0.69 

-0.38 

30710 

C 

0 

3 

10 

1.66 

0.27 

3.75 

0.18 

30710 

D 

0 

1 

3 

-1.04 

0.00 

0.23 

-0.21 

30711 

* 

-1 

1877 

99 

1.52 

0.03 

0.00 

-0.01 

30711 

A 

1 

16 

94 

1.83 

0.40 

0.91 

0.37 

30711 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30711 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30711 

D 

0 

1 

6 

-0.70 

0.00 

0.27 

-0.37 

30715 

* 

-1 

1864 

98 

1.53 

0.03 

0.00 

0.05 

30715 

A 

1 

25 

83 

1.31 

0.33 

1.51 

0.40 

30715 

B 

0 

2 

7 

-0.45 

0.22 

0.46 

-0.24 

30715 

C 

0 

3 

10 

-0.43 

0.45 

0.55 

-0.30 

30715 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30716 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.05 

30716 

A 

1 

21 

95 

0.87 

0.28 

1.07 

-0.01 

30716 

B 

0 

1 

5 

0.95 

0.00 

1.89 

0.01 

30716 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30716 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30717 

* 

-1 

1882 

99 

1.53 

0.03 

0.00 

0.02 

30717 

A 

-1 

12 

100 

1.19 

0.50 

0.00 

0.00 

30717 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30717 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30717 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30718 

* 

-1 

1874 

99 

1.52 

0.03 

0.00 

0.00 

30718 

A 

1 

17 

85 

1.81 

0.29 

0.84 

0.47 

30718 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30718 

C 

0 

2 

10 

0.33 

0.99 

0.77 

-0.32 

30718 

D 

0 

1 

5 

-0.26 

0.00 

0.28 

-0.33 

30724 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.03 

30724 

A 

1 

13 

72 

1.98 

0.39 

0.70 

0.67 

30724 

B 

0 

1 

6 

-1.21 

0.00 

0.13 

-0.26 

30724 

C 

0 

1 

6 

-5.21 

0.00 

0.00 

-0.70 

30724 

D 

0 

3 

17 

0.04 

0.52 

0.56 

-0.21 

30725 

* 

-1 

1872 

99 

1.52 

0.03 

0.00 

-0.03 

30725 

A 

1 

17 

77 

2.56 

0.41 

0.90 

0.55 

30725 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30725 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30725 

D 

0 

5 

23 

-0.45 

1.32 

1.20 

-0.55 

30735 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.06 

30735 

A 

1 

5 

28 

1.76 

0.34 

0.49 

0.63 

30735 

B 

0 

5 

28 

-0.13 

0.36 

0.47 

-0.41 

30735 

C 

0 

2 

11 

-0.23 

0.99 

0.51 

-0.27 

30735 

D 

0 

6 

33 

0.56 

0.41 

1.10 

-0.03 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30736 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.05 

30736 

A 

1 

7 

37 

1.85 

0.54 

0.92 

0.53 

30736 

B 

0 

2 

11 

-0.51 

0.44 

0.24 

-0.32 

30736 

C 

0 

7 

37 

0.52 

0.54 

1.21 

-0.17 

30736 

D 

0 

3 

16 

0.11 

0.58 

0.58 

-0.22 

30738 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.02 

30738 

A 

1 

13 

65 

1.97 

0.35 

0.77 

0.64 

30738 

B 

0 

4 

20 

-0.39 

0.80 

0.52 

-0.53 

30738 

C 

0 

1 

5 

1.04 

0.00 

1.10 

-0.03 

30738 

D 

0 

2 

10 

-0.12 

0.13 

0.35 

-0.29 

30741 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

30741 

A 

-1 

24 

100 

0.88 

0.28 

0.00 

0.00 

30741 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30741 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30741 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30742 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.03 

30742 

A 

1 

13 

76 

1.34 

0.43 

1.21 

0.23 

30742 

B 

0 

1 

6 

0.84 

0.00 

1.30 

-0.04 

30742 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30742 

D 

0 

3 

18 

0.30 

1.72 

5.19 

-0.22 

30743 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.04 

30743 

A 

1 

12 

63 

1.52 

0.50 

1.10 

0.45 

30743 

B 

0 

4 

21 

0.21 

0.50 

1.00 

-0.22 

30743 

C 

0 

1 

5 

0.04 

0.00 

0.58 

-0.13 

30743 

D 

0 

2 

11 

-0.68 

1.67 

0.78 

-0.33 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30745 

* 

-1 

1880 

99 

1.52 

0.03 

0.00 

-0.01 

30745 

A 

1 

11 

79 

1.99 

0.32 

0.91 

0.40 

30745 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30745 

C 

0 

1 

7 

2.63 

0.00 

3.51 

0.20 

30745 

D 

0 

2 

14 

-0.13 

0.91 

0.32 

-0.61 

30746 

* 

-1 

1866 

99 

1.52 

0.03 

0.00 

-0.02 

30746 

A 

1 

26 

93 

1.88 

0.30 

0.85 

0.42 

30746 

B 

0 

1 

4 

-0.31 

0.00 

0.37 

-0.24 

30746 

C 

0 

1 

4 

-1.11 

0.00 

0.17 

-0.34 

30746 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30747 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.00 

30747 

A 

1 

6 

33 

2.49 

0.70 

1.31 

0.42 

30747 

B 

0 

4 

22 

0.99 

0.74 

0.99 

-0.17 

30747 

C 

0 

5 

28 

1.22 

0.40 

0.83 

-0.10 

30747 

D 

0 

3 

17 

0.67 

1.58 

1.42 

-0.23 

30754 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.06 

30754 

A 

1 

7 

32 

1.28 

0.51 

1.12 

0.38 

30754 

B 

0 

1 

5 

0.30 

0.00 

0.60 

-0.08 

30754 

C 

0 

6 

27 

0.89 

0.35 

1.45 

0.12 

30754 

D 

0 

8 

36 

0.08 

0.25 

0.58 

-0.44 

30756 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.02 

30756 

A 

1 

11 

65 

1.72 

0.64 

1.47 

0.33 

30756 

B 

0 

2 

12 

-0.38 

0.87 

0.54 

-0.33 

30756 

C 

0 

1 

6 

2.21 

0.00 

5.12 

0.13 

30756 

D 

0 

3 

18 

0.38 

0.20 

0.85 

-0.22 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30757 

* 

-1 

1878 

99 

1.53 

0.03 

0.00 

0.04 

30757 

A 

1 

8 

50 

1.30 

0.58 

1.20 

0.25 

30757 

B 

0 

5 

31 

0.59 

0.62 

1.56 

-0.16 

30757 

C 

0 

2 

13 

0.51 

1.42 

1.77 

-0.11 

30757 

D 

0 

1 

6 

0.61 

0.00 

0.89 

-0.06 

30760 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.03 

30760 

A 

1 

15 

75 

1.50 

0.38 

1.28 

0.50 

30760 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30760 

C 

0 

3 

15 

0.19 

0.26 

0.70 

-0.25 

30760 

D 

0 

2 

10 

-0.78 

0.13 

0.25 

-0.42 

30761 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.05 

30761 

A 

-1 

17 

94 

1.17 

0.30 

0.00 

0.78 

30761 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30761 

C 

-1 

1 

6 

-5.21 

0.00 

0.00 

-0.78 

30761 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30852 

* 

-1 

1884 

99 

1.52 

0.03 

0.00 

-0.01 

30852 

A 

1 

7 

70 

2.28 

0.39 

0.59 

0.77 

30852 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30852 

C 

0 

2 

20 

0.20 

0.55 

0.38 

-0.55 

30852 

D 

0 

1 

10 

-0.11 

0.00 

0.24 

-0.44 

30856 

* 

-1 

1867 

99 

1.53 

0.03 

0.00 

0.01 

30856 

A 

1 

11 

41 

2.18 

0.52 

1.44 

0.42 

30856 

B 

0 

5 

19 

0.37 

1.04 

2.61 

-0.29 

30856 

C 

0 

6 

22 

1.28 

0.41 

1.46 

-0.02 

30856 

D 

0 

5 

19 

0.62 

0.31 

0.56 

-0.21 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30864 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.03 

30864 

A 

1 

12 

67 

1.68 

0.42 

1.22 

0.54 

30864 

B 

0 

6 

33 

0.03 

0.37 

0.64 

-0.54 

30864 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30864 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30871 

* 

-1 

1875 

99 

1.54 

0.03 

0.00 

0.08 

30871 

A 

1 

10 

53 

0.64 

0.55 

1.90 

0.13 

30871 

B 

0 

5 

26 

0.13 

0.50 

1.17 

-0.14 

30871 

C 

0 

2 

11 

-0.20 

0.53 

0.67 

-0.16 

30871 

D 

0 

2 

11 

1.06 

1.36 

4.27 

0.14 

30873 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.05 

30873 

A 

-1 

19 

100 

0.79 

0.34 

0.00 

0.00 

30873 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30873 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30873 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

30875 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.07 

30875 

A 

1 

20 

95 

0.70 

0.31 

1.05 

0.18 

30875 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30875 

C 

0 

1 

5 

-0.46 

0.00 

0.67 

-0.18 

30875 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30884 

* 

-1 

1885 

100 

1.53 

0.03 

0.00 

0.07 

30884 

A 

1 

7 

78 

0.81 

0.24 

1.10 

0.58 

30884 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30884 

C 

0 

1 

11 

1.31 

0.00 

1.73 

0.20 

30884 

D 

0 

1 

11 

-5.21 

0.00 

0.00 

-0.96 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

30889 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.04 

30889 

A 

1 

15 

88 

0.97 

0.32 

1.24 

0.14 

30889 

B 

0 

2 

12 

0.47 

0.05 

1.00 

-0.14 

30889 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30889 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

30890 

* 

-1 

1867 

99 

1.54 

0.03 

0.00 

0.07 

30890 

A 

1 

16 

59 

1.08 

0.40 

1.37 

0.28 

30890 

B 

0 

2 

7 

0.36 

0.29 

0.86 

-0.09 

30890 

C 

0 

7 

26 

0.13 

0.28 

0.80 

-0.29 

30890 

D 

0 

2 

7 

0.95 

0.63 

1.77 

0.04 

30907 

* 

-1 

1878 

99 

1.52 

0.03 

0.00 

-0.01 

30907 

A 

1 

12 

75 

2.24 

0.37 

0.64 

0.67 

30907 

B 

0 

2 

13 

0.11 

1.06 

0.61 

-0.37 

30907 

C 

0 

1 

6 

0.07 

0.00 

0.36 

-0.26 

30907 

D 

0 

1 

6 

-0.93 

0.00 

0.13 

-0.43 

30912 

* 

-1 

1867 

99 

1.53 

0.03 

0.00 

0.04 

30912 

A 

1 

11 

41 

1.95 

0.68 

2.59 

0.38 

30912 

B 

0 

4 

15 

0.91 

0.53 

1.26 

-0.04 

30912 

C 

0 

7 

26 

0.85 

0.62 

2.45 

-0.07 

30912 

D 

0 

5 

19 

-0.38 

0.66 

0.44 

-0.37 

30945 

* 

-1 

1869 

99 

1.53 

0.03 

0.00 

0.02 

30945 

A 

1 

9 

36 

2.51 

0.70 

2.50 

0.52 

30945 

B 

0 

1 

4 

-0.40 

0.00 

0.16 

-0.20 

30945 

C 

0 

8 

32 

0.83 

0.36 

0.83 

-0.19 

30945 

D 

0 

7 

28 

0.54 

0.55 

0.71 

-0.27 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31001 

* 

-1 

1865 

98 

1.53 

0.03 

0.00 

0.04 

31001 

A 

1 

26 

90 

1.29 

0.20 

0.89 

0.43 

31001 

B 

0 

1 

3 

1.27 

0.00 

1.88 

0.02 

31001 

C 

0 

1 

3 

-0.97 

0.00 

0.20 

-0.35 

31001 

D 

0 

1 

3 

-1.20 

0.00 

0.16 

-0.39 

31003 

* 

-1 

1882 

99 

1.53 

0.03 

0.00 

0.07 

31003 

A 

1 

9 

75 

0.77 

0.48 

0.85 

0.46 

31003 

B 

0 

1 

8 

0.61 

0.00 

1.97 

0.05 

31003 

C 

0 

1 

8 

-1.07 

0.00 

0.37 

-0.30 

31003 

D 

0 

1 

8 

-1.85 

0.00 

0.17 

-0.47 

31012 

* 

-1 

1864 

98 

1.53 

0.03 

0.00 

0.02 

31012 

A 

1 

21 

70 

1.85 

0.32 

0.92 

0.53 

31012 

B 

0 

3 

10 

-0.51 

0.52 

0.32 

-0.39 

31012 

C 

0 

4 

13 

0.34 

0.36 

0.71 

-0.25 

31012 

D 

0 

2 

7 

0.37 

1.41 

1.37 

-0.16 

31013 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.02 

31013 

A 

1 

16 

94 

1.39 

0.41 

0.60 

0.50 

31013 

B 

0 

1 

6 

-2.40 

0.00 

0.08 

-0.50 

31013 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31013 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31014 

* 

-1 

1870 

99 

1.53 

0.03 

0.00 

0.05 

31014 

A 

1 

16 

67 

1.40 

0.29 

0.88 

0.50 

31014 

B 

0 

3 

13 

0.11 

0.25 

0.57 

-0.26 

31014 

C 

0 

4 

17 

0.11 

0.76 

1.06 

-0.31 

31014 

D 

0 

1 

4 

-0.18 

0.00 

0.40 

-0.19 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31015 

* 

-1 

1875 

99 

1.52 

0.03 

0.00 

0.00 

31015 

A 

1 

18 

95 

1.68 

0.38 

0.86 

0.36 

31015 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31015 

C 

0 

1 

5 

-0.91 

0.00 

0.22 

-0.36 

31015 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31016 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.02 

31016 

A 

1 

11 

48 

1.51 

0.43 

2.26 

0.15 

31016 

B 

0 

3 

13 

0.59 

0.52 

0.59 

-0.24 

31016 

C 

0 

7 

30 

1.42 

0.46 

1.62 

0.05 

31016 

D 

0 

2 

9 

1.05 

0.19 

0.72 

-0.07 

31018 

* 

-1 

1877 

99 

1.53 

0.03 

0.00 

0.06 

31018 

A 

1 

12 

71 

1.01 

0.37 

1.07 

0.39 

31018 

B 

0 

4 

24 

-0.31 

0.41 

0.65 

-0.46 

31018 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31018 

D 

0 

1 

6 

1.07 

0.00 

1.93 

0.07 

31019 

* 

-1 

1874 

99 

1.53 

0.03 

0.00 

0.01 

31019 

A 

1 

15 

75 

1.90 

0.53 

1.20 

0.43 

31019 

B 

0 

4 

20 

0.25 

0.24 

0.81 

-0.30 

31019 

C 

0 

1 

5 

-1.18 

0.00 

0.18 

-0.31 

31019 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31020 

* 

-1 

1869 

99 

1.52 

0.03 

0.00 

-0.01 

31020 

A 

1 

12 

48 

2.83 

0.47 

1.32 

0.62 

31020 

B 

0 

2 

8 

0.34 

0.26 

0.29 

-0.22 

31020 

C 

0 

8 

32 

1.22 

0.41 

1.13 

-0.17 

31020 

D 

0 

3 

12 

-0.88 

0.53 

0.11 

-0.52 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31021 

* 

-1 

1880 

99 

1.52 

0.03 

0.00 

-0.01 

31021 

A 

1 

12 

86 

2.07 

0.45 

0.68 

0.55 

31021 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31021 

C 

0 

1 

7 

-0.14 

0.00 

0.40 

-0.30 

31021 

D 

0 

1 

7 

-1.04 

0.00 

0.16 

-0.45 

31022 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.02 

31022 

A 

1 

18 

82 

1.35 

0.35 

1.12 

0.13 

31022 

B 

0 

1 

5 

0.78 

0.00 

1.17 

-0.07 

31022 

C 

0 

2 

9 

-0.52 

0.43 

0.35 

-0.37 

31022 

D 

0 

1 

5 

3.67 

0.00 

20.91 

0.35 

31025 

* 

-1 

1868 

99 

1.53 

0.03 

0.00 

0.04 

31025 

A 

1 

11 

42 

1.88 

0.68 

2.48 

0.42 

31025 

B 

0 

3 

12 

-0.22 

0.41 

0.40 

-0.25 

31025 

C 

0 

8 

31 

0.46 

0.30 

0.99 

-0.21 

31025 

D 

0 

4 

15 

0.63 

0.79 

1.41 

-0.09 

31156 

* 

-1 

1879 

99 

1.52 

0.03 

0.00 

0.00 

31156 

A 

1 

11 

73 

2.06 

0.53 

1.08 

0.46 

31156 

B 

0 

3 

20 

0.42 

0.99 

1.73 

-0.33 

31156 

C 

0 

1 

7 

-0.33 

0.00 

0.31 

-0.29 

31156 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31159 

* 

-1 

1865 

98 

1.53 

0.03 

0.00 

0.04 

31159 

A 

1 

15 

52 

1.82 

0.44 

1.20 

0.48 

31159 

B 

0 

10 

34 

0.55 

0.28 

1.02 

-0.22 

31159 

C 

0 

1 

3 

0.37 

0.00 

0.62 

-0.08 

31159 

D 

0 

3 

10 

-0.84 

1.24 

0.49 

-0.39 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31160 

* 

-1 

1873 

99 

1.52 

0.03 

0.00 

0.00 

31160 

A 

1 

20 

95 

1.69 

0.40 

0.97 

0.30 

31160 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31160 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31160 

D 

0 

1 

5 

-0.77 

0.00 

0.31 

-0.30 

31162 

* 

-1 

1871 

99 

1.53 

0.03 

0.00 

0.04 

31162 

A 

1 

21 

91 

1.05 

0.36 

1.11 

0.16 

31162 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31162 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31162 

D 

0 

2 

9 

0.16 

0.18 

0.97 

-0.16 

31163 

* 

-1 

1554 

82 

1.45 

0.04 

0.00 

-0.11 

31163 

A 

1 

238 

70 

2.11 

0.08 

1.17 

0.32 

31163 

B 

0 

15 

4 

1.19 

0.32 

1.33 

-0.12 

31163 

C 

0 

87 

26 

1.28 

0.11 

1.26 

-0.28 

31163 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31180 

* 

-1 

1866 

99 

1.53 

0.03 

0.00 

0.01 

31180 

A 

1 

23 

82 

1.62 

0.24 

1.05 

0.28 

31180 

B 

0 

3 

11 

0.64 

0.67 

0.91 

-0.24 

31180 

C 

0 

1 

4 

2.39 

0.00 

3.74 

0.15 

31180 

D 

0 

1 

4 

-0.52 

0.00 

0.20 

-0.32 

31181 

* 

-1 

1879 

99 

1.52 

0.03 

0.00 

-0.02 

31181 

A 

-1 

15 

100 

1.89 

0.44 

0.00 

0.00 

31181 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31181 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

31181 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31182 

* 

-1 

1873 

99 

1.53 

0.03 

0.00 

0.06 

31182 

A 

1 

14 

67 

1.23 

0.38 

0.93 

0.47 

31182 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31182 

C 

0 

3 

14 

-0.02 

0.27 

0.65 

-0.19 

31182 

D 

0 

4 

19 

-0.57 

1.09 

0.85 

-0.39 

31186 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.04 

31186 

A 

1 

16 

89 

1.31 

0.43 

1.21 

0.38 

31186 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31186 

C 

0 

1 

6 

2.54 

0.00 

10.26 

0.17 

31186 

D 

0 

1 

6 

-5.24 

0.00 

0.00 

-0.69 

31193 

* 

-1 

1872 

99 

1.53 

0.03 

0.00 

0.04 

31193 

A 

1 

19 

86 

1.19 

0.33 

0.75 

0.31 

31193 

B 

0 

1 

5 

-0.94 

0.00 

0.31 

-0.26 

31193 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31193 

D 

0 

2 

9 

0.01 

2.70 

5.88 

-0.19 

31200 

* 

-1 

1866 

99 

1.53 

0.03 

0.00 

0.04 

31200 

A 

1 

26 

93 

1.22 

0.33 

0.89 

0.26 

31200 

B 

0 

2 

7 

-0.45 

1.65 

1.51 

-0.26 

31200 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31200 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

31201 

* 

-1 

1875 

99 

1.53 

0.03 

0.00 

0.03 

31201 

A 

1 

17 

89 

1.31 

0.31 

0.92 

0.40 

31201 

B 

0 

1 

5 

-0.11 

0.00 

0.49 

-0.23 

31201 

C 

0 

1 

5 

-0.58 

0.00 

0.30 

-0.32 

31201 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

31203 

* 

-1 

1718 

91 

1.54 

0.03 

0.00 

0.03 

31203 

A 

1 

151 

86 

1.58 

0.10 

1.00 

0.35 

31203 

B 

0 

9 

5 

0.26 

0.30 

0.71 

-0.21 

31203 

C 

0 

14 

8 

0.37 

0.33 

0.99 

-0.24 

31203 

D 

0 

2 

1 

0.38 

1.17 

1.03 

-0.09 

31205 

* 

-1 

1865 

98 

1.53 

0.03 

0.00 

0.04 

31205 

A 

1 

17 

59 

1.77 

0.37 

1.76 

0.50 

31205 

B 

0 

8 

28 

0.51 

0.40 

1.14 

-0.23 

31205 

C 

0 

2 

7 

0.57 

0.03 

0.70 

-0.09 

31205 

D 

0 

2 

7 

-1.67 

0.82 

0.10 

-0.47 

31208 

* 

-1 

1878 

99 

1.53 

0.03 

0.00 

0.04 

31208 

A 

1 

6 

38 

2.30 

0.94 

1.57 

0.50 

31208 

B 

0 

5 

31 

1.06 

0.44 

1.68 

0.04 

31208 

C 

0 

1 

6 

-1.55 

0.00 

0.10 

-0.30 

31208 

D 

0 

4 

25 

-0.67 

1.06 

0.56 

-0.43 

31209 

* 

-1 

1878 

99 

1.52 

0.03 

0.00 

-0.01 

31209 

A 

1 

9 

56 

2.32 

0.44 

0.92 

0.41 

31209 

B 

0 

4 

25 

1.30 

1.36 

5.30 

-0.13 

31209 

C 

0 

2 

13 

0.94 

0.63 

0.65 

-0.16 

31209 

D 

0 

1 

6 

-0.92 

0.00 

0.08 

-0.39 

31210 

* 

-1 

1876 

99 

1.53 

0.03 

0.00 

0.02 

31210 

A 

1 

12 

67 

1.92 

0.47 

0.83 

0.52 

31210 

B 

0 

1 

6 

1.32 

0.00 

1.83 

0.00 

31210 

C 

0 

3 

17 

-0.37 

0.88 

0.74 

-0.44 

31210 

D 

0 

2 

11 

0.03 

0.96 

0.75 

-0.26 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G11 

* 

-1 

1816 

96 

1.52 

0.03 

0.00 

-0.02 

1G1 1 

A 

1 

75 

96 

1.72 

0.14 

0.95 

0.28 

1G11 

B 

0 

3 

4 

-0.05 

0.71 

0.51 

-0.28 

1G11 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G1 1 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G110 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

1G110 

A 

1 

65 

90 

1.93 

0.15 

0.98 

0.35 

1G110 

B 

0 

3 

4 

-0.38 

0.82 

0.45 

-0.36 

1G110 

C 

0 

4 

6 

1.05 

0.68 

1.34 

-0.14 

1G110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G111 

* 

-1 

1807 

95 

1.52 

0.03 

0.00 

0.00 

1G111 

A 

1 

70 

80 

1.80 

0.14 

0.97 

0.43 

1G111 

B 

0 

7 

8 

0.50 

0.39 

0.73 

-0.24 

1G111 

C 

0 

10 

11 

0.38 

0.33 

0.63 

-0.33 

1G111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G112 

* 

-1 

1797 

95 

1.51 

0.03 

0.00 

-0.05 

1G112 

A 

1 

96 

99 

1.80 

0.12 

1.01 

0.03 

1G112 

B 

0 

1 

1 

1.47 

0.00 

1.09 

-0.03 

1G112 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G113 

* 

-1 

1745 

92 

1.51 

0.03 

0.00 

-0.03 

1G113 

A 

1 

138 

93 

1.78 

0.09 

0.89 

0.35 

1G113 

B 

0 

5 

3 

0.56 

0.70 

1.16 

-0.19 

1G113 

C 

0 

6 

4 

0.08 

0.20 

0.36 

-0.29 

1G113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G114 

* 

-1 

1821 

96 

1.50 

0.03 

0.00 

-0.09 

1G114 

A 

1 

61 

84 

2.36 

0.14 

0.92 

0.36 

1G114 

B 

0 

9 

12 

1.43 

0.34 

1.08 

-0.25 

1G114 

C 

0 

3 

4 

0.82 

0.66 

0.59 

-0.25 

1G114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G115 

* 

-1 

1818 

96 

1.53 

0.03 

0.00 

0.02 

1G115 

A 

1 

66 

87 

1.63 

0.14 

0.82 

0.47 

1G115 

B 

0 

5 

7 

-0.26 

0.55 

0.56 

-0.35 

1G115 

C 

0 

5 

7 

0.02 

0.34 

0.51 

-0.29 

1G115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G116 

* 

-1 

1746 

92 

1.50 

0.03 

0.00 

-0.06 

1G116 

A 

1 

143 

97 

1.83 

0.11 

1.06 

0.13 

1G116 

B 

0 

4 

3 

1.01 

0.17 

1.00 

-0.10 

1G116 

C 

0 

1 

1 

0.20 

0.00 

0.42 

-0.10 

1G116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G117 

* 

-1 

1820 

96 

1.53 

0.03 

0.00 

0.03 

1G117 

A 

1 

56 

76 

1.51 

0.15 

1.05 

0.33 

1G117 

B 

0 

11 

15 

0.67 

0.37 

1.15 

-0.22 

1G117 

C 

0 

7 

9 

0.50 

0.45 

0.93 

-0.22 

1G117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G118 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

1G118 

A 

1 

62 

85 

2.02 

0.13 

1.07 

0.17 

1G118 

B 

0 

7 

10 

1.78 

0.46 

2.65 

-0.05 

1G118 

C 

0 

4 

5 

0.97 

0.65 

0.97 

-0.21 

1G118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G119 

* 

-1 

1815 

96 

1.52 

0.03 

0.00 

-0.03 

1G119 

A 

1 

66 

84 

1.88 

0.14 

0.95 

0.36 

1G119 

B 

0 

5 

6 

0.29 

0.18 

0.36 

-0.33 

1G119 

C 

0 

8 

10 

1.11 

0.17 

0.84 

-0.18 

1G119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G12 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1G12 

A 

1 

71 

97 

1.66 

0.13 

0.87 

0.35 

1G12 

B 

0 

1 

1 

-1.58 

0.00 

0.08 

-0.33 

1G12 

C 

0 

1 

1 

0.04 

0.00 

0.38 

-0.16 

1G12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G120 

* 

-1 

1815 

96 

1.51 

0.03 

0.00 

-0.05 

1G120 

A 

1 

74 

94 

1.98 

0.13 

0.89 

0.35 

1G120 

B 

0 

2 

3 

0.33 

0.64 

0.45 

-0.21 

1G120 

C 

0 

3 

4 

0.23 

0.77 

0.52 

-0.27 

1G120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G121 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1G121 

A 

1 

84 

98 

1.49 

0.13 

1.03 

0.14 

1G121 

B 

0 

2 

2 

0.42 

0.24 

0.65 

-0.14 

1G121 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G122 

* 

-1 

1809 

96 

1.53 

0.03 

0.00 

0.01 

1G122 

A 

1 

72 

85 

1.53 

0.13 

1.07 

0.15 

1G122 

B 

0 

8 

9 

0.81 

0.42 

1.48 

-0.19 

1G122 

C 

0 

5 

6 

1.49 

0.57 

3.50 

0.01 

1G122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G123 

* 

-1 

1813 

96 

1.52 

0.03 

0.00 

-0.03 

1G123 

A 

1 

65 

80 

1.81 

0.12 

1.10 

0.20 

1G123 

B 

0 

3 

4 

0.85 

0.16 

0.49 

-0.17 

1G123 

C 

0 

13 

16 

1.43 

0.32 

1.54 

-0.13 

1G123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G124 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1G124 

A 

1 

58 

82 

2.24 

0.17 

0.95 

0.46 

1G124 

B 

0 

7 

10 

0.58 

0.30 

0.60 

-0.33 

1G124 

C 

0 

6 

8 

0.61 

0.28 

0.55 

-0.29 

1G124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G125 

* 

-1 

1816 

96 

1.52 

0.03 

0.00 

-0.02 

1G125 

A 

1 

72 

92 

1.79 

0.14 

0.92 

0.37 

1G125 

B 

0 

6 

8 

0.07 

0.43 

0.53 

-0.37 

1G125 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G126 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1G126 

A 

-1 

71 

100 

1.84 

0.14 

0.00 

0.00 

1G126 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G126 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G126 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G127 

* 

-1 

1809 

96 

1.52 

0.03 

0.00 

0.00 

1G127 

A 

1 

78 

92 

1.66 

0.14 

0.99 

0.29 

1G127 

B 

0 

4 

5 

0.97 

0.50 

1.40 

-0.10 

1G127 

C 

0 

3 

4 

-0.55 

0.79 

0.37 

-0.32 

1G127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G128 

* 

-1 

1798 

95 

1.51 

0.03 

0.00 

-0.05 

1G128 

A 

1 

86 

90 

1.94 

0.12 

1.02 

0.26 

1G128 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G128 

C 

0 

10 

10 

1.01 

0.19 

0.73 

-0.26 

1G128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G129 

* 

-1 

1821 

96 

1.50 

0.03 

0.00 

-0.09 

1G129 

A 

1 

68 

93 

2.22 

0.14 

1.05 

0.11 

1G129 

B 

0 

4 

5 

2.01 

0.42 

1.82 

-0.04 

1G129 

C 

0 

1 

1 

0.56 

0.00 

0.32 

-0.17 

1G129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G13 

* 

-1 

1818 

96 

1.53 

0.03 

0.00 

0.02 

1G13 

A 

1 

73 

96 

1.48 

0.14 

0.90 

0.33 

1G13 

B 

0 

2 

3 

-0.43 

1.04 

0.49 

-0.24 

1G13 

C 

0 

1 

1 

-1.06 

0.00 

0.17 

-0.22 

1G13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G130 

* 

-1 

1820 

96 

1.53 

0.03 

0.00 

0.03 

1G130 

A 

1 

62 

84 

1.56 

0.14 

0.97 

0.50 

1G130 

B 

0 

5 

7 

0.41 

0.18 

0.66 

-0.20 

1G130 

C 

0 

7 

9 

-0.41 

0.37 

0.44 

-0.46 

1G130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G131 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

1G131 

A 

1 

66 

90 

2.06 

0.13 

0.98 

0.35 

1G131 

B 

0 

6 

8 

0.69 

0.32 

0.59 

-0.34 

1G131 

C 

0 

1 

1 

1.33 

0.00 

0.84 

-0.07 

1G131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G132 

* 

-1 

1816 

96 

1.52 

0.03 

0.00 

-0.03 

1G132 

A 

-1 

78 

100 

1.71 

0.13 

0.00 

0.00 

1G132 

B 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G132 

C 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G132 

D 

-1 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G133 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1G133 

A 

1 

46 

63 

1.89 

0.16 

1.16 

0.35 

1G133 

B 

0 

19 

26 

0.91 

0.24 

0.86 

-0.36 

1G133 

C 

0 

8 

11 

1.51 

0.32 

1.62 

-0.03 

1G133 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G134 

* 

-1 

1815 

96 

1.51 

0.03 

0.00 

-0.05 

1G134 

A 

1 

69 

87 

2.04 

0.14 

1.02 

0.37 

1G134 

B 

0 

3 

4 

-0.25 

0.14 

0.19 

-0.35 

1G134 

C 

0 

7 

9 

1.15 

0.22 

0.88 

-0.19 

1G134 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G135 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1G135 

A 

1 

62 

72 

1.68 

0.16 

1.12 

0.29 

1G135 

B 

0 

14 

16 

0.90 

0.23 

1.03 

-0.21 

1G135 

C 

0 

10 

12 

0.94 

0.35 

1.19 

-0.16 

1G135 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G136 

* 

-1 

1751 

92 

1.50 

0.03 

0.00 

-0.06 

1G136 

A 

1 

103 

72 

2.16 

0.12 

1.07 

0.45 

1G136 

B 

0 

4 

3 

0.37 

0.33 

0.37 

-0.20 

1G136 

C 

0 

36 

25 

0.97 

0.14 

0.81 

-0.39 

1G136 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G137 

* 

-1 

1809 

96 

1.53 

0.03 

0.00 

0.01 

1G137 

A 

1 

81 

95 

1.53 

0.12 

0.94 

0.29 

1G137 

B 

0 

2 

2 

0.13 

0.39 

0.46 

-0.19 

1G137 

C 

0 

2 

2 

-0.09 

0.78 

0.45 

-0.22 

1G137 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G138 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.04 

1G138 

A 

1 

59 

80 

1.92 

0.13 

1.09 

0.19 

1G138 

B 

0 

9 

12 

1.55 

0.23 

1.18 

-0.11 

1G138 

C 

0 

6 

8 

1.36 

0.18 

0.87 

-0.15 

1G138 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G139 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1G139 

A 

1 

54 

76 

2.20 

0.19 

1.13 

0.35 

1G139 

B 

0 

15 

21 

1.20 

0.26 

1.22 

-0.28 

1G139 

C 

0 

2 

3 

0.20 

0.00 

0.28 

-0.22 

1G139 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G14 

* 

-1 

1816 

96 

1.52 

0.03 

0.00 

-0.02 

1G14 

A 

1 

70 

90 

1.78 

0.14 

0.99 

0.30 

1G14 

B 

0 

6 

8 

0.83 

0.56 

1.37 

-0.19 

1G14 

C 

0 

2 

3 

-0.27 

0.66 

0.31 

-0.26 

1G14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G140 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1G140 

A 

1 

67 

94 

1.94 

0.14 

0.92 

0.35 

1G140 

B 

0 

1 

1 

-0.69 

0.00 

0.14 

-0.25 

1G140 

C 

0 

3 

4 

0.38 

0.30 

0.45 

-0.26 

1G140 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G15 

* 

-1 

1809 

96 

1.52 

0.03 

0.00 

0.00 

1G15 

A 

1 

72 

85 

1.82 

0.13 

0.93 

0.50 

1G15 

B 

0 

9 

11 

-0.08 

0.32 

0.43 

-0.45 

1G15 

C 

0 

4 

5 

0.40 

0.15 

0.52 

-0.20 

1G15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G16 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1G16 

A 

1 

62 

65 

2.18 

0.14 

1.00 

0.41 

1G16 

B 

0 

22 

23 

1.35 

0.14 

0.87 

-0.26 

1G16 

C 

0 

11 

12 

1.08 

0.29 

0.83 

-0.26 

1G16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G17 

* 

-1 

1821 

96 

1.50 

0.03 

0.00 

-0.09 

1G17 

A 

1 

61 

84 

2.33 

0.14 

1.05 

0.31 

1G17 

B 

0 

4 

5 

1.22 

0.25 

0.61 

-0.21 

1G17 

C 

0 

8 

11 

1.50 

0.33 

1.05 

-0.21 

1G17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G18 

* 

-1 

1819 

96 

1.53 

0.03 

0.00 

0.02 

1G18 

A 

1 

29 

39 

1.92 

0.25 

1.35 

0.32 

1G18 

B 

0 

20 

27 

0.81 

0.26 

0.90 

-0.29 

1G18 

C 

0 

26 

35 

1.31 

0.22 

1.50 

-0.06 

1G18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G19 

* 

-1 

1820 

96 

1.53 

0.03 

0.00 

0.03 

1G19 

A 

1 

58 

78 

1.33 

0.15 

1.49 

0.05 

1G19 

B 

0 

12 

16 

1.40 

0.39 

3.47 

0.04 

1G19 

C 

0 

4 

5 

0.50 

0.68 

1.18 

-0.16 

1G19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G21 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1G21 

A 

1 

68 

94 

2.03 

0.13 

0.96 

0.31 

1G21 

B 

0 

1 

1 

1.15 

0.00 

0.74 

-0.09 

1G21 

C 

0 

3 

4 

0.34 

0.42 

0.38 

-0.31 

1G21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G210 

* 

-1 

1732 

91 

1.51 

0.03 

0.00 

-0.03 

1G210 

A 

1 

122 

75 

1.98 

0.10 

0.90 

0.45 

1G210 

B 

0 

22 

14 

0.69 

0.16 

0.70 

-0.33 

1G210 

C 

0 

18 

11 

0.83 

0.25 

0.92 

-0.25 

1G210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G211 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.03 

1G211 

A 

1 

48 

62 

1.98 

0.17 

1.13 

0.30 

1G211 

B 

0 

7 

9 

1.15 

0.24 

0.78 

-0.17 

1G211 

C 

0 

22 

29 

1.35 

0.18 

1.19 

-0.22 

1G211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G212 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1G212 

A 

1 

63 

86 

1.75 

0.13 

0.94 

0.35 

1G212 

B 

0 

2 

3 

1.00 

0.96 

1.24 

-0.09 

1G212 

C 

0 

8 

11 

0.50 

0.45 

1.00 

-0.34 

1G212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G213 

* 

-1 

1815 

96 

1.51 

0.03 

0.00 

-0.05 

1G213 

A 

1 

57 

72 

2.22 

0.15 

0.95 

0.48 

1G213 

B 

0 

21 

27 

1.03 

0.16 

0.69 

-0.43 

1G213 

C 

0 

1 

1 

-0.47 

0.00 

0.13 

-0.22 

1G213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G214 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1G214 

A 

1 

71 

83 

1.47 

0.15 

1.31 

0.00 

1G214 

B 

0 

14 

16 

1.61 

0.20 

2.19 

0.05 

1G214 

C 

0 

1 

1 

-0.48 

0.00 

0.21 

-0.18 

1G214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G215 

* 

-1 

1811 

96 

1.53 

0.03 

0.00 

0.01 

1G215 

A 

1 

78 

94 

1.56 

0.12 

0.96 

0.28 

1G215 

B 

0 

4 

5 

0.54 

0.19 

0.66 

-0.19 

1G215 

C 

0 

1 

1 

-0.86 

0.00 

0.15 

-0.23 

1G215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G216 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.04 

1G216 

A 

1 

60 

81 

2.02 

0.12 

0.90 

0.43 

1G216 

B 

0 

5 

7 

1.19 

0.28 

0.80 

-0.18 

1G216 

C 

0 

9 

12 

0.90 

0.21 

0.61 

-0.37 

1G216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G217 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1G217 

A 

1 

68 

96 

2.01 

0.16 

0.98 

0.26 

1G217 

B 

0 

2 

3 

0.54 

0.34 

0.55 

-0.17 

1G217 

C 

0 

1 

1 

-0.30 

0.00 

0.23 

-0.20 

1G217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G218 

* 

-1 

1816 

96 

1.52 

0.03 

0.00 

-0.02 

1G218 

A 

1 

71 

91 

1.76 

0.14 

0.95 

0.28 

1G218 

B 

0 

5 

6 

1.09 

0.68 

2.12 

-0.12 

1G218 

C 

0 

2 

3 

-0.70 

0.76 

0.22 

-0.31 

1G218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G219 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1G219 

A 

1 

68 

96 

1.87 

0.14 

1.02 

0.12 

1G219 

B 

0 

2 

3 

0.29 

0.44 

0.42 

-0.22 

1G219 

C 

0 

1 

1 

2.84 

0.00 

4.88 

0.10 

1G219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G22 

* 

-1 

1810 

96 

1.52 

0.03 

0.00 

0.00 

1G22 

A 

1 

72 

86 

1.77 

0.13 

0.91 

0.42 

1G22 

B 

0 

6 

7 

-0.30 

0.44 

0.38 

-0.40 

1G22 

C 

0 

6 

7 

0.79 

0.60 

1.91 

-0.17 

1G22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G220 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1G220 

A 

1 

81 

85 

1.99 

0.12 

1.02 

0.29 

1G220 

B 

0 

5 

5 

1.20 

0.24 

0.82 

-0.15 

1G220 

C 

0 

9 

9 

1.05 

0.27 

0.82 

-0.24 

1G220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G221 

* 

-1 

1749 

92 

1.54 

0.03 

0.00 

0.03 

1G221 

A 

1 

91 

63 

1.72 

0.12 

1.05 

0.37 

1G221 

B 

0 

21 

14 

0.52 

0.26 

0.91 

-0.28 

1G221 

C 

0 

33 

23 

0.95 

0.18 

1.25 

-0.19 

1G221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G222 

* 

-1 

1821 

96 

1.50 

0.03 

0.00 

-0.09 

1G222 

A 

1 

64 

88 

2.36 

0.13 

0.94 

0.42 

1G222 

B 

0 

5 

7 

0.89 

0.18 

0.44 

-0.31 

1G222 

C 

0 

4 

5 

0.99 

0.34 

0.56 

-0.26 

1G222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G223 

* 

-1 

1819 

96 

1.53 

0.03 

0.00 

0.02 

1G223 

A 

1 

69 

92 

1.58 

0.14 

0.85 

0.44 

1G223 

B 

0 

6 

8 

-0.50 

0.33 

0.37 

-0.44 

1G223 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G224 

* 

-1 

1820 

96 

1.53 

0.03 

0.00 

0.03 

1G224 

A 

1 

61 

82 

1.46 

0.15 

1.05 

0.31 

1G224 

B 

0 

8 

11 

1.00 

0.23 

1.31 

-0.09 

1G224 

C 

0 

5 

7 

-0.33 

0.62 

0.53 

-0.37 

1G224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G225 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1G225 

A 

1 

58 

81 

2.08 

0.14 

1.08 

0.26 

1G225 

B 

0 

8 

11 

1.73 

0.43 

1.98 

-0.07 

1G225 

C 

0 

6 

8 

0.87 

0.28 

0.58 

-0.29 

1G225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G226 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.03 

1G226 

A 

1 

69 

90 

1.81 

0.13 

1.00 

0.22 

1G226 

B 

0 

4 

5 

0.90 

0.51 

0.97 

-0.18 

1G226 

C 

0 

4 

5 

1.13 

0.36 

0.96 

-0.13 

1G226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G227 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1G227 

A 

1 

69 

95 

1.70 

0.13 

0.88 

0.40 

1G227 

B 

0 

1 

1 

-0.27 

0.00 

0.26 

-0.20 

1G227 

C 

0 

3 

4 

-0.24 

0.67 

0.38 

-0.34 

1G227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G228 

* 

-1 

1815 

96 

1.51 

0.03 

0.00 

-0.05 

1G228 

A 

1 

23 

29 

1.98 

0.34 

2.60 

0.06 

1G228 

B 

0 

54 

68 

1.86 

0.13 

1.42 

-0.01 

1G228 

C 

0 

2 

3 

0.86 

0.84 

0.44 

-0.14 

1G228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G229 

* 

-1 

1746 

92 

1.51 

0.03 

0.00 

-0.05 

1G229 

A 

1 

133 

90 

1.92 

0.10 

0.89 

0.42 

1G229 

B 

0 

11 

7 

0.00 

0.29 

0.45 

-0.41 

1G229 

C 

0 

4 

3 

0.84 

0.19 

0.73 

-0.12 

1G229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G23 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1G23 

A 

1 

76 

88 

1.57 

0.14 

1.00 

0.24 

1G23 

B 

0 

9 

10 

0.93 

0.29 

1.29 

-0.16 

1G23 

C 

0 

1 

1 

-1.44 

0.00 

0.09 

-0.27 

1G23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G230 

* 

-1 

1811 

96 

1.53 

0.03 

0.00 

0.01 

1G230 

A 

1 

80 

96 

1.54 

0.12 

0.95 

0.28 

1G230 

B 

0 

3 

4 

-0.10 

0.41 

0.39 

-0.28 

1G230 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G231 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.04 

1G231 

A 

1 

65 

88 

1.88 

0.12 

1.02 

0.15 

1G231 

B 

0 

5 

7 

1.66 

0.22 

1.24 

-0.05 

1G231 

C 

0 

4 

5 

1.18 

0.59 

1.20 

-0.17 

1G231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G232 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1G232 

A 

1 

64 

90 

2.01 

0.17 

1.06 

0.16 

1G232 

B 

0 

4 

6 

0.76 

0.22 

0.65 

-0.21 

1G232 

C 

0 

3 

4 

1.98 

1.27 

5.60 

0.01 

1G232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G233 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1G233 

A 

1 

57 

74 

2.02 

0.15 

0.94 

0.50 

1G233 

B 

0 

15 

19 

0.94 

0.23 

0.90 

-0.29 

1G233 

C 

0 

5 

6 

-0.30 

0.30 

0.22 

-0.42 

1G233 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G234 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1G234 

A 

1 

35 

49 

2.34 

0.19 

1.01 

0.42 

1G234 

B 

0 

6 

8 

1.90 

0.48 

1.81 

0.02 

1G234 

C 

0 

30 

42 

1.23 

0.19 

1.08 

-0.43 

1G234 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G235 

* 

-1 

1812 

96 

1.52 

0.03 

0.00 

-0.01 

1G235 

A 

1 

61 

74 

1.90 

0.15 

1.16 

0.40 

1G235 

B 

0 

14 

17 

0.96 

0.20 

0.89 

-0.25 

1G235 

C 

0 

7 

9 

0.52 

0.31 

0.60 

-0.28 

1G235 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G236 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1G236 

A 

1 

61 

64 

2.11 

0.13 

1.02 

0.30 

1G236 

B 

0 

4 

4 

0.33 

0.20 

0.27 

-0.30 

1G236 

C 

0 

30 

32 

1.57 

0.19 

1.80 

-0.19 

1G236 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G237 

* 

-1 

1823 

96 

1.50 

0.03 

0.00 

-0.09 

1G237 

A 

1 

57 

80 

2.46 

0.14 

0.89 

0.50 

1G237 

B 

0 

5 

7 

1.33 

0.21 

0.65 

-0.21 

1G237 

C 

0 

9 

13 

0.88 

0.22 

0.47 

-0.44 

1G237 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G238 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1G238 

A 

1 

60 

85 

1.63 

0.16 

0.94 

0.33 

1G238 

B 

0 

2 

3 

-0.08 

1.39 

0.74 

-0.21 

1G238 

C 

0 

9 

13 

0.59 

0.39 

1.23 

-0.26 

1G238 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G239 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1G239 

A 

1 

69 

95 

1.43 

0.13 

0.82 

0.44 

1G239 

B 

0 

4 

5 

-0.90 

0.52 

0.29 

-0.44 

1G239 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G239 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G24 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1G24 

A 

1 

64 

89 

2.09 

0.13 

0.96 

0.37 

1G24 

B 

0 

6 

8 

0.40 

0.23 

0.39 

-0.43 

1G24 

C 

0 

2 

3 

2.00 

0.49 

1.83 

0.01 

1G24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G240 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1G240 

A 

1 

28 

37 

1.91 

0.24 

1.62 

0.11 

1G240 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G240 

C 

0 

48 

63 

1.66 

0.14 

1.59 

-0.11 

1G240 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G25 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1G25 

A 

1 

47 

64 

1.94 

0.15 

1.04 

0.41 

1G25 

B 

0 

25 

34 

1.00 

0.21 

1.01 

-0.38 

1G25 

C 

0 

1 

1 

0.35 

0.00 

0.33 

-0.13 

1G25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G26 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

1G26 

A 

1 

64 

85 

2.07 

0.14 

0.98 

0.31 

1G26 

B 

0 

5 

7 

0.57 

0.40 

0.50 

-0.32 

1G26 

C 

0 

6 

8 

1.49 

0.18 

1.04 

-0.11 

1G26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G27 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1G27 

A 

1 

84 

98 

1.51 

0.13 

1.00 

0.20 

1G27 

B 

0 

2 

2 

-0.07 

0.41 

0.42 

-0.20 

1G27 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G28 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1G28 

A 

1 

67 

83 

1.60 

0.13 

1.04 

0.28 

1G28 

B 

0 

7 

9 

1.19 

0.25 

1.32 

-0.08 

1G28 

C 

0 

7 

9 

0.41 

0.33 

0.68 

-0.30 

1G28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G29 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

1G29 

A 

1 

55 

76 

1.99 

0.13 

0.97 

0.38 

1G29 

B 

0 

12 

17 

1.17 

0.15 

0.75 

-0.30 

1G29 

C 

0 

5 

7 

1.16 

0.30 

0.79 

-0.19 

1G29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G31 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1G31 

A 

1 

69 

97 

1.99 

0.16 

0.95 

0.26 

1G31 

B 

0 

1 

1 

-0.47 

0.00 

0.20 

-0.21 

1G31 

C 

0 

1 

1 

0.20 

0.00 

0.38 

-0.15 

1G31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G310 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1G310 

A 

1 

71 

92 

1.76 

0.14 

1.07 

0.27 

1G310 

B 

0 

5 

6 

0.37 

0.44 

0.70 

-0.28 

1G310 

C 

0 

1 

1 

1.35 

0.00 

1.34 

-0.03 

1G310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G311 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1G311 

A 

1 

34 

48 

2.32 

0.22 

1.34 

0.39 

1G311 

B 

0 

33 

46 

1.47 

0.17 

1.13 

-0.29 

1G311 

C 

0 

4 

6 

0.71 

0.38 

0.42 

-0.23 

1G311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G312 

* 

-1 

1812 

96 

1.52 

0.03 

0.00 

-0.01 

1G312 

A 

1 

28 

34 

1.74 

0.28 

2.29 

0.07 

1G312 

B 

0 

20 

24 

1.62 

0.21 

1.35 

0.00 

1G312 

C 

0 

34 

41 

1.52 

0.18 

1.31 

-0.07 

1G312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G313 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1G313 

A 

1 

79 

83 

2.03 

0.12 

0.99 

0.36 

1G313 

B 

0 

4 

4 

1.11 

0.39 

0.79 

-0.15 

1G313 

C 

0 

12 

13 

0.97 

0.18 

0.69 

-0.32 

1G313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G314 

* 

-1 

1823 

96 

1.50 

0.03 

0.00 

-0.09 

1G314 

A 

1 

48 

68 

2.30 

0.17 

1.28 

0.16 

1G314 

B 

0 

16 

23 

2.11 

0.21 

1.57 

-0.04 

1G314 

C 

0 

7 

10 

1.51 

0.44 

1.04 

-0.20 

1G314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G315 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1G315 

A 

1 

52 

73 

1.78 

0.17 

1.03 

0.43 

1G315 

B 

0 

1 

1 

0.28 

0.00 

0.44 

-0.11 

1G315 

C 

0 

18 

25 

0.56 

0.22 

0.82 

-0.41 

1G315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G316 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1G316 

A 

1 

60 

82 

1.44 

0.15 

1.09 

0.25 

1G316 

B 

0 

11 

15 

0.88 

0.33 

1.51 

-0.15 

1G316 

C 

0 

2 

3 

-0.46 

1.45 

0.57 

-0.25 

1G316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G317 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1G317 

A 

1 

59 

82 

2.13 

0.14 

1.03 

0.37 

1G317 

B 

0 

2 

3 

1.36 

1.49 

1.83 

-0.09 

1G317 

C 

0 

11 

15 

1.04 

0.21 

0.72 

-0.35 

1G317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G318 

* 

-1 

1746 

92 

1.50 

0.03 

0.00 

-0.07 

1G318 

A 

1 

140 

95 

1.92 

0.09 

0.96 

0.30 

1G318 

B 

0 

5 

3 

0.63 

0.22 

0.52 

-0.21 

1G318 

C 

0 

3 

2 

0.21 

0.18 

0.32 

-0.21 

1G318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G319 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1G319 

A 

1 

53 

70 

2.01 

0.15 

0.98 

0.36 

1G319 

B 

0 

5 

7 

0.74 

0.30 

0.54 

-0.25 

1G319 

C 

0 

18 

24 

1.26 

0.19 

1.02 

-0.25 

1G319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G32 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1G32 

A 

1 

59 

81 

1.81 

0.14 

1.18 

0.40 

1G32 

B 

0 

10 

14 

0.72 

0.24 

0.76 

-0.31 

1G32 

C 

0 

4 

5 

0.60 

0.27 

0.58 

-0.22 

1G32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G320 

* 

-1 

1738 

92 

1.51 

0.03 

0.00 

-0.03 

1G320 

A 

1 

138 

88 

1.74 

0.09 

1.04 

0.23 

1G320 

B 

0 

6 

4 

0.78 

0.35 

0.77 

-0.17 

1G320 

C 

0 

12 

8 

1.11 

0.19 

1.04 

-0.15 

1G320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G321 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

1G321 

A 

1 

38 

51 

2.56 

0.19 

0.84 

0.57 

1G321 

B 

0 

24 

32 

1.35 

0.11 

0.72 

-0.34 

1G321 

C 

0 

13 

17 

1.12 

0.26 

0.70 

-0.32 

1G321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G322 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1G322 

A 

1 

76 

88 

1.61 

0.13 

0.97 

0.34 

1G322 

B 

0 

6 

7 

0.65 

0.24 

0.79 

-0.19 

1G322 

C 

0 

4 

5 

-0.06 

0.51 

0.47 

-0.28 

1G322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G323 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1G323 

A 

1 

24 

30 

2.27 

0.26 

0.99 

0.49 

1G323 

B 

0 

31 

38 

1.15 

0.14 

0.89 

-0.23 

1G323 

C 

0 

26 

32 

1.09 

0.16 

0.86 

-0.24 

1G323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G324 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

1G324 

A 

1 

26 

36 

2.16 

0.19 

1.10 

0.29 

1G324 

B 

0 

42 

58 

1.66 

0.13 

1.26 

-0.17 

1G324 

C 

0 

4 

6 

0.86 

0.27 

0.40 

-0.25 

1G324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G325 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1G325 

A 

1 

63 

89 

2.12 

0.17 

0.94 

0.38 

1G325 

B 

0 

7 

10 

0.59 

0.33 

0.73 

-0.33 

1G325 

C 

0 

1 

1 

-0.30 

0.00 

0.21 

-0.20 

1G325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G326 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1G326 

A 

1 

33 

43 

2.08 

0.24 

1.83 

0.29 

1G326 

B 

0 

36 

47 

1.40 

0.17 

1.10 

-0.20 

1G326 

C 

0 

8 

10 

1.10 

0.40 

0.82 

-0.15 

1G326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G327 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1G327 

A 

1 

59 

83 

2.08 

0.14 

0.86 

0.45 

1G327 

B 

0 

9 

13 

0.86 

0.32 

0.82 

-0.31 

1G327 

C 

0 

3 

4 

0.02 

0.37 

0.28 

-0.32 

1G327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G328 

* 

-1 

1813 

96 

1.52 

0.03 

0.00 

-0.02 

1G328 

A 

1 

34 

42 

2.23 

0.22 

1.21 

0.42 

1G328 

B 

0 

42 

52 

1.33 

0.13 

0.97 

-0.27 

1G328 

C 

0 

5 

6 

0.20 

0.61 

0.51 

-0.31 

1G328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G329 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1G329 

A 

1 

60 

63 

2.14 

0.15 

1.16 

0.34 

1G329 

B 

0 

24 

25 

1.47 

0.15 

1.03 

-0.21 

1G329 

C 

0 

11 

12 

1.18 

0.23 

0.81 

-0.23 

1G329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G33 

* 

-1 

1823 

96 

1.50 

0.03 

0.00 

-0.09 

1G33 

A 

1 

22 

31 

2.59 

0.28 

1.62 

0.25 

1G33 

B 

0 

12 

17 

1.61 

0.26 

0.66 

-0.23 

1G33 

C 

0 

37 

52 

2.12 

0.17 

1.34 

-0.05 

1G33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G330 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1G330 

A 

1 

27 

38 

2.04 

0.28 

1.77 

0.36 

1G330 

B 

0 

26 

37 

1.13 

0.18 

1.06 

-0.19 

1G330 

C 

0 

18 

25 

1.02 

0.27 

1.02 

-0.20 

1G330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G331 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1G331 

A 

1 

27 

37 

1.71 

0.26 

2.01 

0.26 

1G331 

B 

0 

24 

33 

1.24 

0.20 

1.32 

-0.03 

1G331 

C 

0 

22 

30 

0.87 

0.23 

0.94 

-0.24 

1G331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G332 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1G332 

A 

1 

39 

54 

2.31 

0.16 

1.05 

0.36 

1G332 

B 

0 

13 

18 

1.50 

0.36 

1.35 

-0.19 

1G332 

C 

0 

20 

28 

1.53 

0.21 

1.04 

-0.24 

1G332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G333 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1G333 

A 

1 

70 

92 

1.82 

0.13 

1.02 

0.21 

1G333 

B 

0 

2 

3 

0.53 

0.25 

0.46 

-0.18 

1G333 

C 

0 

4 

5 

1.20 

0.19 

0.91 

-0.12 

1G333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G334 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1G334 

A 

1 

48 

66 

1.85 

0.15 

1.10 

0.32 

1G334 

B 

0 

17 

23 

0.96 

0.23 

0.95 

-0.31 

1G334 

C 

0 

8 

11 

1.42 

0.54 

2.00 

-0.06 

1G334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G335 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

1G335 

A 

1 

44 

59 

2.38 

0.18 

0.98 

0.47 

1G335 

B 

0 

15 

20 

1.20 

0.19 

0.73 

-0.32 

1G335 

C 

0 

16 

21 

1.36 

0.19 

0.89 

-0.26 

1G335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G336 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1G336 

A 

1 

53 

62 

1.86 

0.16 

0.93 

0.42 

1G336 

B 

0 

13 

15 

0.67 

0.28 

0.81 

-0.28 

1G336 

C 

0 

20 

23 

0.95 

0.24 

1.27 

-0.24 

1G336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G337 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1G337 

A 

1 

49 

60 

1.75 

0.16 

1.04 

0.33 

1G337 

B 

0 

24 

30 

1.10 

0.17 

1.13 

-0.22 

1G337 

C 

0 

8 

10 

0.78 

0.42 

1.16 

-0.21 

1G337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G338 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

1G338 

A 

1 

66 

92 

1.89 

0.11 

0.94 

0.34 

1G338 

B 

0 

5 

7 

0.80 

0.21 

0.54 

-0.30 

1G338 

C 

0 

1 

1 

0.53 

0.00 

0.38 

-0.16 

1G338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G339 

* 

-1 

1717 

91 

1.50 

0.03 

0.00 

-0.05 

1G339 

A 

1 

42 

24 

2.33 

0.21 

1.51 

0.28 

1G339 

B 

0 

42 

24 

1.32 

0.14 

0.73 

-0.21 

1G339 

C 

0 

93 

53 

1.68 

0.11 

1.27 

-0.06 

1G339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G34 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1G34 

A 

1 

56 

79 

2.18 

0.19 

1.12 

0.35 

1G34 

B 

0 

8 

11 

1.21 

0.32 

1.10 

-0.19 

1G34 

C 

0 

7 

10 

0.80 

0.34 

0.77 

-0.27 

1G34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G340 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1G340 

A 

1 

73 

95 

1.75 

0.14 

1.03 

0.31 

1G340 

B 

0 

1 

1 

0.57 

0.00 

0.64 

-0.10 

1G340 

C 

0 

3 

4 

-0.16 

0.22 

0.33 

-0.30 

1G340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G341 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1G341 

A 

1 

44 

62 

2.20 

0.18 

1.16 

0.39 

1G341 

B 

0 

10 

14 

1.28 

0.32 

1.15 

-0.19 

1G341 

C 

0 

17 

24 

1.22 

0.22 

0.93 

-0.29 

1G341 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G342 

* 

-1 

1813 

96 

1.52 

0.03 

0.00 

-0.02 

1G342 

A 

1 

61 

75 

1.94 

0.14 

0.95 

0.44 

1G342 

B 

0 

4 

5 

1.11 

0.23 

0.87 

-0.10 

1G342 

C 

0 

16 

20 

0.63 

0.25 

0.72 

-0.42 

1G342 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G343 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1G343 

A 

1 

45 

47 

2.37 

0.18 

1.17 

0.45 

1G343 

B 

0 

6 

6 

1.20 

0.28 

0.63 

-0.16 

1G343 

C 

0 

44 

46 

1.43 

0.11 

0.84 

-0.37 

1G343 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G344 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1G344 

A 

1 

27 

39 

2.55 

0.23 

1.34 

0.27 

1G344 

B 

0 

7 

10 

1.62 

0.38 

0.76 

-0.16 

1G344 

C 

0 

36 

51 

1.99 

0.17 

1.26 

-0.16 

1G344 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G345 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1G345 

A 

1 

49 

69 

1.65 

0.20 

1.46 

0.24 

1G345 

B 

0 

17 

24 

1.07 

0.21 

1.23 

-0.17 

1G345 

C 

0 

5 

7 

0.74 

0.42 

0.87 

-0.15 

1G345 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1G35 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1G35 

A 

1 

60 

82 

1.57 

0.14 

0.89 

0.48 

1G35 

B 

0 

5 

7 

0.00 

0.50 

0.56 

-0.30 

1G35 

C 

0 

8 

11 

0.11 

0.37 

0.66 

-0.35 

1G35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G36 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1G36 

A 

1 

63 

88 

2.02 

0.14 

1.12 

0.19 

1G36 

B 

0 

2 

3 

1.27 

0.93 

1.12 

-0.10 

1G36 

C 

0 

7 

10 

1.42 

0.31 

1.19 

-0.16 

1G36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G37 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1G37 

A 

1 

42 

55 

2.04 

0.19 

1.24 

0.29 

1G37 

B 

0 

12 

16 

1.40 

0.15 

0.91 

-0.14 

1G37 

C 

0 

22 

29 

1.39 

0.18 

1.09 

-0.21 

1G37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G38 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1G38 

A 

1 

53 

73 

1.92 

0.14 

0.91 

0.46 

1G38 

B 

0 

5 

7 

0.58 

0.37 

0.64 

-0.25 

1G38 

C 

0 

15 

21 

0.81 

0.29 

0.92 

-0.36 

1G38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1G39 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

1G39 

A 

1 

39 

52 

2.16 

0.20 

1.24 

0.22 

1G39 

B 

0 

20 

27 

1.60 

0.20 

1.15 

-0.17 

1G39 

C 

0 

16 

21 

1.74 

0.26 

1.54 

-0.08 

1G39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD11 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1MD11 

A 

1 

83 

97 

1.55 

0.12 

0.87 

0.35 

1MD11 

B 

0 

2 

2 

-0.71 

0.73 

0.25 

-0.28 

1MD11 

C 

0 

1 

1 

-0.83 

0.00 

0.18 

-0.21 

1MD11 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD110 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1MD110 

A 

1 

61 

75 

1.63 

0.14 

1.08 

0.27 

1MD110 

B 

0 

20 

25 

0.96 

0.19 

1.10 

-0.27 

1MD110 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD110 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD111 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

1MD111 

A 

1 

65 

90 

1.88 

0.11 

0.94 

0.28 

1MD111 

B 

0 

3 

4 

0.86 

0.25 

0.56 

-0.21 

1MD111 

C 

0 

4 

6 

1.10 

0.60 

1.19 

-0.18 

1MD111 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD112 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1MD112 

A 

1 

69 

97 

1.97 

0.16 

0.99 

0.13 

1MD112 

B 

0 

1 

1 

2.24 

0.00 

2.92 

0.03 

1MD112 

C 

0 

1 

1 

-0.47 

0.00 

0.20 

-0.21 

1MD112 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD113 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1MD113 

A 

1 

61 

79 

1.92 

0.14 

0.94 

0.41 

1MD113 

B 

0 

4 

5 

1.07 

0.27 

0.92 

-0.11 

1MD113 

C 

0 

12 

16 

0.54 

0.39 

1.02 

-0.39 

1MD113 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD114 

* 

-1 

1732 

91 

1.51 

0.03 

0.00 

-0.03 

1MD114 

A 

1 

156 

96 

1.73 

0.09 

0.93 

0.24 

1MD114 

B 

0 

4 

2 

0.76 

0.68 

1.51 

-0.12 

1MD114 

C 

0 

2 

1 

-0.87 

0.57 

0.16 

-0.24 

1MD114 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD115 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1MD115 

A 

1 

69 

97 

1.88 

0.14 

1.01 

0.20 

1MD115 

B 

0 

1 

1 

0.55 

0.00 

0.50 

-0.13 

1MD115 

C 

0 

1 

1 

0.38 

0.00 

0.42 

-0.15 

1MD115 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD116 

* 

-1 

1813 

96 

1.52 

0.03 

0.00 

-0.02 

1MD116 

A 

1 

77 

95 

1.74 

0.13 

0.94 

0.37 

1MD116 

B 

0 

2 

2 

-0.25 

0.00 

0.27 

-0.25 

1MD116 

C 

0 

2 

2 

-0.34 

0.08 

0.25 

-0.26 

1MD116 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD117 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1MD117 

A 

1 

80 

84 

2.05 

0.11 

0.86 

0.41 

1MD117 

B 

0 

4 

4 

0.34 

0.19 

0.32 

-0.29 

1MD117 

C 

0 

11 

12 

1.02 

0.40 

2.85 

-0.28 

1MD117 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD118 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1MD118 

A 

1 

47 

67 

2.52 

0.16 

0.94 

0.44 

1MD118 

B 

0 

15 

21 

1.69 

0.26 

1.18 

-0.22 

1MD118 

C 

0 

8 

11 

1.03 

0.25 

0.48 

-0.36 

1MD118 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS First Grade Math Measure Development 


338 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD119 

* 

-1 

1750 

92 

1.50 

0.03 

0.00 

-0.06 

1MD119 

A 

1 

120 

83 

2.01 

0.11 

1.05 

0.36 

1MD119 

B 

0 

9 

6 

0.67 

0.19 

0.58 

-0.24 

1MD119 

C 

0 

15 

10 

0.90 

0.27 

0.99 

-0.25 

1MD119 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD12 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1MD12 

A 

1 

61 

86 

1.69 

0.15 

0.89 

0.48 

1MD12 

B 

0 

4 

6 

-0.44 

0.50 

0.38 

-0.36 

1MD12 

C 

0 

6 

8 

0.23 

0.14 

0.51 

-0.29 

1MD12 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD120 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1MD120 

A 

1 

37 

51 

1.89 

0.17 

0.96 

0.50 

1MD120 

B 

0 

7 

10 

0.19 

0.38 

0.45 

-0.30 

1MD120 

C 

0 

29 

40 

0.82 

0.20 

1.25 

-0.33 

1MD120 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD121 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1MD121 

A 

1 

39 

54 

2.16 

0.18 

1.38 

0.22 

1MD121 

B 

0 

3 

4 

0.94 

0.38 

0.43 

-0.19 

1MD121 

C 

0 

30 

42 

1.76 

0.19 

1.38 

-0.14 

1MD121 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD122 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1MD122 

A 

1 

75 

99 

1.76 

0.13 

1.00 

0.10 

1MD122 

B 

0 

1 

1 

0.78 

0.00 

0.60 

-0.10 

1MD122 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD122 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD123 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1MD123 

A 

1 

24 

33 

2.13 

0.26 

2.36 

0.33 

1MD123 

B 

0 

36 

49 

1.44 

0.17 

1.24 

-0.14 

1MD123 

C 

0 

13 

18 

1.05 

0.23 

0.66 

-0.23 

1MD123 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD124 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

1MD124 

A 

1 

60 

80 

2.14 

0.14 

0.95 

0.38 

1MD124 

B 

0 

2 

3 

0.49 

0.16 

0.34 

-0.21 

1MD124 

C 

0 

13 

17 

1.15 

0.23 

0.88 

-0.31 

1MD124 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD125 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1MD125 

A 

1 

55 

64 

1.79 

0.16 

1.13 

0.36 

1MD125 

B 

0 

23 

27 

1.07 

0.18 

1.16 

-0.20 

1MD125 

C 

0 

8 

9 

0.43 

0.34 

0.59 

-0.28 

1MD125 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD126 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1MD126 

A 

1 

70 

86 

1.55 

0.13 

1.05 

0.21 

1MD126 

B 

0 

6 

7 

0.64 

0.39 

0.89 

-0.21 

1MD126 

C 

0 

5 

6 

1.21 

0.36 

1.50 

-0.06 

1MD126 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD127 

* 

-1 

1746 

92 

1.50 

0.03 

0.00 

-0.06 

1MD127 

A 

1 

82 

55 

2.10 

0.14 

1.39 

0.26 

1MD127 

B 

0 

22 

15 

0.76 

0.24 

0.87 

-0.33 

1MD127 

C 

0 

44 

30 

1.74 

0.18 

2.03 

-0.03 

1MD127 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD128 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

1MD128 

A 

1 

46 

64 

2.09 

0.14 

0.94 

0.42 

1MD128 

B 

0 

14 

19 

1.32 

0.21 

0.97 

-0.25 

1MD128 

C 

0 

12 

17 

1.25 

0.15 

0.75 

-0.27 

1MD128 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD129 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1MD129 

A 

1 

58 

82 

2.19 

0.17 

1.00 

0.39 

1MD129 

B 

0 

10 

14 

0.97 

0.34 

1.08 

-0.28 

1MD129 

C 

0 

3 

4 

0.25 

0.20 

0.34 

-0.26 

1MD129 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD13 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1MD13 

A 

1 

61 

79 

2.04 

0.13 

0.81 

0.60 

1MD13 

B 

0 

8 

10 

0.30 

0.40 

0.59 

-0.38 

1MD13 

C 

0 

8 

10 

0.12 

0.14 

0.34 

-0.43 

1MD13 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD130 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1MD130 

A 

1 

53 

75 

2.16 

0.15 

0.89 

0.47 

1MD130 

B 

0 

11 

15 

1.00 

0.21 

0.75 

-0.30 

1MD130 

C 

0 

7 

10 

0.68 

0.46 

0.76 

-0.32 

1MD130 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD131 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1MD131 

A 

1 

71 

89 

1.82 

0.13 

0.91 

0.40 

1MD131 

B 

0 

7 

9 

0.31 

0.39 

0.63 

-0.35 

1MD131 

C 

0 

2 

3 

0.33 

0.59 

0.51 

-0.18 

1MD131 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD132 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1MD132 

A 

1 

36 

38 

2.49 

0.18 

0.93 

0.46 

1MD132 

B 

0 

53 

56 

1.53 

0.13 

0.99 

-0.34 

1MD132 

C 

0 

6 

6 

0.96 

0.14 

0.39 

-0.22 

1MD132 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD14 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1MD14 

A 

1 

65 

93 

2.26 

0.14 

0.99 

0.29 

1MD14 

B 

0 

3 

4 

0.95 

0.33 

0.53 

-0.23 

1MD14 

C 

0 

2 

3 

1.06 

0.49 

0.59 

-0.17 

1MD14 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD15 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1MD15 

A 

1 

59 

83 

1.69 

0.16 

1.03 

0.42 

1MD15 

B 

0 

11 

15 

0.35 

0.23 

0.68 

-0.37 

1MD15 

C 

0 

1 

1 

-0.53 

0.00 

0.22 

-0.19 

1MD15 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD16 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1MD16 

A 

1 

46 

63 

1.78 

0.17 

1.23 

0.52 

1MD16 

B 

0 

17 

23 

0.65 

0.17 

0.75 

-0.30 

1MD16 

C 

0 

10 

14 

0.22 

0.30 

0.53 

-0.36 

1MD16 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD17 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1MD17 

A 

1 

45 

63 

2.27 

0.15 

1.06 

0.39 

1MD17 

B 

0 

9 

13 

1.32 

0.34 

1.02 

-0.22 

1MD17 

C 

0 

18 

25 

1.44 

0.24 

1.10 

-0.27 

1MD17 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD18 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1MD18 

A 

1 

37 

49 

2.27 

0.19 

0.96 

0.46 

1MD18 

B 

0 

7 

9 

1.45 

0.35 

1.07 

-0.09 

1MD18 

C 

0 

32 

42 

1.22 

0.13 

0.81 

-0.42 

1MD18 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD19 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1MD19 

A 

1 

64 

88 

1.75 

0.13 

0.91 

0.38 

1MD19 

B 

0 

7 

10 

0.35 

0.45 

0.71 

-0.36 

1MD19 

C 

0 

2 

3 

0.89 

0.85 

1.04 

-0.11 

1MD19 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD21 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

1MD21 

A 

1 

64 

85 

2.05 

0.14 

1.04 

0.27 

1MD21 

B 

0 

9 

12 

1.32 

0.21 

0.96 

-0.20 

1MD21 

C 

0 

2 

3 

0.60 

0.90 

0.57 

-0.19 

1MD21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD210 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1MD210 

A 

1 

18 

21 

1.77 

0.35 

1.99 

0.13 

1MD210 

B 

0 

12 

14 

0.89 

0.33 

0.71 

-0.20 

1MD210 

C 

0 

56 

65 

1.50 

0.14 

1.43 

0.03 

1MD210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD211 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1MD211 

A 

1 

58 

72 

1.60 

0.15 

1.12 

0.20 

1MD211 

B 

0 

20 

25 

1.20 

0.21 

1.44 

-0.14 

1MD211 

C 

0 

3 

4 

0.57 

0.73 

0.77 

-0.16 

1MD211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD212 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.04 

1MD212 

A 

1 

23 

32 

1.87 

0.25 

1.72 

0.06 

1MD212 

B 

0 

44 

61 

1.85 

0.12 

1.32 

0.08 

1MD212 

C 

0 

5 

7 

0.95 

0.12 

0.40 

-0.25 

1MD212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD213 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.06 

1MD213 

A 

1 

67 

94 

2.06 

0.16 

0.90 

0.36 

1MD213 

B 

0 

1 

1 

-0.47 

0.00 

0.19 

-0.21 

1MD213 

C 

0 

3 

4 

0.03 

0.33 

0.35 

-0.29 

1MD213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD214 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1MD214 

A 

1 

71 

92 

1.81 

0.13 

0.86 

0.41 

1MD214 

B 

0 

5 

6 

-0.09 

0.66 

0.79 

-0.37 

1MD214 

C 

0 

1 

1 

0.06 

0.00 

0.37 

-0.15 

1MD214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD215 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1MD215 

A 

1 

63 

89 

2.05 

0.14 

0.82 

0.50 

1MD215 

B 

0 

3 

4 

0.20 

0.52 

0.41 

-0.29 

1MD215 

C 

0 

5 

7 

0.13 

0.21 

0.32 

-0.39 

1MD215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD216 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1MD216 

A 

1 

76 

95 

1.76 

0.13 

0.87 

0.40 

1MD216 

B 

0 

3 

4 

-0.56 

0.41 

0.23 

-0.37 

1MD216 

C 

0 

1 

1 

-0.09 

0.00 

0.31 

-0.16 

1MD216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD217 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1MD217 

A 

1 

53 

56 

2.19 

0.15 

1.02 

0.34 

1MD217 

B 

0 

18 

19 

1.43 

0.19 

0.94 

-0.19 

1MD217 

C 

0 

24 

25 

1.46 

0.22 

1.27 

-0.21 

1MD217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD218 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1MD218 

A 

1 

39 

56 

2.51 

0.18 

1.17 

0.33 

1MD218 

B 

0 

19 

27 

1.61 

0.23 

1.00 

-0.30 

1MD218 

C 

0 

12 

17 

1.97 

0.29 

1.39 

-0.08 

1MD218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD219 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1MD219 

A 

1 

62 

87 

1.68 

0.15 

0.81 

0.48 

1MD219 

B 

0 

5 

7 

-0.60 

0.35 

0.28 

-0.45 

1MD219 

C 

0 

4 

6 

0.41 

0.39 

0.71 

-0.20 

1MD219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD22 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1MD22 

A 

1 

65 

89 

1.52 

0.13 

0.75 

0.52 

1MD22 

B 

0 

8 

11 

-0.48 

0.40 

0.49 

-0.52 

1MD22 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD220 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1MD220 

A 

1 

65 

90 

2.09 

0.13 

0.95 

0.40 

1MD220 

B 

0 

2 

3 

0.33 

0.00 

0.31 

-0.25 

1MD220 

C 

0 

5 

7 

0.71 

0.34 

0.57 

-0.31 

1MD220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD221 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1MD221 

A 

1 

62 

82 

1.96 

0.14 

0.94 

0.41 

1MD221 

B 

0 

5 

7 

0.91 

0.25 

0.68 

-0.20 

1MD221 

C 

0 

9 

12 

0.74 

0.18 

0.58 

-0.34 

1MD221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD222 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1MD222 

A 

1 

58 

79 

1.82 

0.14 

1.14 

0.40 

1MD222 

B 

0 

8 

11 

0.79 

0.34 

0.98 

-0.25 

1MD222 

C 

0 

7 

10 

0.64 

0.35 

0.78 

-0.28 

1MD222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD223 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

1MD223 

A 

1 

55 

73 

2.12 

0.16 

1.13 

0.28 

1MD223 

B 

0 

16 

21 

1.37 

0.15 

0.91 

-0.25 

1MD223 

C 

0 

4 

5 

1.44 

0.72 

1.44 

-0.10 

1MD223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD224 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1MD224 

A 

1 

73 

85 

1.68 

0.13 

0.88 

0.42 

1MD224 

B 

0 

5 

6 

0.34 

0.26 

0.56 

-0.24 

1MD224 

C 

0 

8 

9 

0.24 

0.40 

0.77 

-0.33 

1MD224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD225 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1MD225 

A 

1 

76 

94 

1.55 

0.12 

0.93 

0.32 

1MD225 

B 

0 

2 

2 

0.40 

0.66 

0.66 

-0.16 

1MD225 

C 

0 

3 

4 

-0.08 

0.51 

0.43 

-0.28 

1MD225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD226 

* 

-1 

1739 

92 

1.51 

0.03 

0.00 

-0.03 

1MD226 

A 

1 

137 

88 

1.73 

0.09 

1.02 

0.23 

1MD226 

B 

0 

8 

5 

1.18 

0.24 

1.11 

-0.10 

1MD226 

C 

0 

10 

6 

0.86 

0.29 

0.90 

-0.20 

1MD226 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD227 

* 

-1 

1823 

96 

1.52 

0.03 

0.00 

-0.03 

1MD227 

A 

1 

65 

92 

1.86 

0.11 

0.94 

0.34 

1MD227 

B 

0 

3 

4 

0.75 

0.14 

0.49 

-0.24 

1MD227 

C 

0 

3 

4 

0.76 

0.38 

0.55 

-0.24 

1MD227 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD228 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1MD228 

A 

1 

65 

93 

2.08 

0.17 

0.94 

0.34 

1MD228 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD228 

C 

0 

5 

7 

0.25 

0.34 

0.48 

-0.34 

1MD228 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD229 

* 

-1 

1748 

92 

1.52 

0.03 

0.00 

-0.02 

1MD229 

A 

1 

113 

77 

1.86 

0.10 

0.95 

0.38 

1MD229 

B 

0 

24 

16 

1.06 

0.17 

1.06 

-0.21 

1MD229 

C 

0 

9 

6 

0.06 

0.58 

1.26 

-0.34 

1MD229 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD23 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1MD23 

A 

1 

69 

90 

1.85 

0.14 

1.00 

0.46 

1MD23 

B 

0 

8 

10 

0.00 

0.19 

0.37 

-0.46 

1MD23 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD230 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1MD230 

A 

1 

64 

90 

1.95 

0.15 

0.98 

0.30 

1MD230 

B 

0 

4 

6 

0.40 

0.52 

0.59 

-0.29 

1MD230 

C 

0 

3 

4 

1.26 

0.44 

1.09 

-0.10 

1MD230 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD231 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1MD231 

A 

1 

39 

49 

2.24 

0.18 

0.96 

0.48 

1MD231 

B 

0 

13 

16 

1.47 

0.36 

1.49 

-0.07 

1MD231 

C 

0 

28 

35 

0.91 

0.14 

0.63 

-0.46 

1MD231 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD232 

* 

-1 

1799 

95 

1.51 

0.03 

0.00 

-0.06 

1MD232 

A 

1 

46 

48 

2.26 

0.17 

1.14 

0.36 

1MD232 

B 

0 

15 

16 

1.30 

0.20 

0.76 

-0.23 

1MD232 

C 

0 

34 

36 

1.56 

0.15 

1.09 

-0.21 

1MD232 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD24 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1MD24 

A 

1 

47 

67 

2.60 

0.15 

0.84 

0.54 

1MD24 

B 

0 

17 

24 

1.30 

0.18 

0.67 

-0.44 

1MD24 

C 

0 

6 

9 

1.26 

0.39 

0.68 

-0.25 

1MD24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD25 

* 

-1 

1823 

96 

1.53 

0.03 

0.00 

0.01 

1MD25 

A 

1 

55 

77 

1.82 

0.15 

0.77 

0.55 

1MD25 

B 

0 

7 

10 

0.62 

0.41 

1.09 

-0.22 

1MD25 

C 

0 

9 

13 

-0.20 

0.22 

0.34 

-0.50 

1MD25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD26 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1MD26 

A 

1 

55 

75 

1.64 

0.14 

0.86 

0.49 

1MD26 

B 

0 

12 

16 

0.27 

0.34 

0.76 

-0.38 

1MD26 

C 

0 

6 

8 

0.28 

0.34 

0.61 

-0.26 

1MD26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD27 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1MD27 

A 

1 

61 

85 

2.14 

0.13 

0.94 

0.43 

1MD27 

B 

0 

6 

8 

0.39 

0.21 

0.34 

-0.43 

1MD27 

C 

0 

5 

7 

1.36 

0.35 

1.00 

-0.15 

1MD27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD28 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1MD28 

A 

1 

69 

91 

1.87 

0.13 

0.93 

0.35 

1MD28 

B 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD28 

C 

0 

7 

9 

0.55 

0.22 

0.52 

-0.35 

1MD28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD29 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1MD29 

A 

1 

52 

71 

1.85 

0.15 

1.10 

0.35 

1MD29 

B 

0 

7 

10 

0.93 

0.36 

0.97 

-0.19 

1MD29 

C 

0 

14 

19 

0.99 

0.30 

1.15 

-0.26 

1MD29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD31 

* 

-1 

1819 

96 

1.51 

0.03 

0.00 

-0.06 

1MD31 

A 

1 

72 

96 

1.98 

0.13 

0.96 

0.25 

1MD31 

B 

0 

1 

1 

0.33 

0.00 

0.34 

-0.16 

1MD31 

C 

0 

2 

3 

0.60 

0.90 

0.63 

-0.19 

1MD31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD310 

* 

-1 

1746 

92 

1.50 

0.03 

0.00 

-0.07 

1MD310 

A 

1 

105 

71 

2.15 

0.11 

0.99 

0.43 

1MD310 

B 

0 

19 

13 

0.86 

0.16 

0.59 

-0.34 

1MD310 

C 

0 

24 

16 

1.30 

0.14 

0.93 

-0.22 

1MD310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD311 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1MD311 

A 

1 

38 

44 

2.09 

0.19 

1.00 

0.46 

1MD311 

B 

0 

27 

31 

0.77 

0.14 

0.64 

-0.40 

1MD311 

C 

0 

21 

24 

1.25 

0.27 

1.71 

-0.10 

1MD311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD312 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1MD312 

A 

1 

67 

83 

1.64 

0.13 

0.95 

0.36 

1MD312 

B 

0 

12 

15 

0.60 

0.23 

0.76 

-0.33 

1MD312 

C 

0 

2 

2 

0.75 

1.01 

1.07 

-0.10 

1MD312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD313 

* 

-1 

1823 

96 

1.52 

0.03 

0.00 

-0.03 

1MD313 

A 

1 

52 

73 

1.86 

0.12 

1.04 

0.18 

1MD313 

B 

0 

17 

24 

1.62 

0.21 

1.45 

-0.09 

1MD313 

C 

0 

2 

3 

0.53 

0.16 

0.35 

-0.24 

1MD313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD314 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1MD314 

A 

1 

57 

81 

2.22 

0.17 

0.89 

0.40 

1MD314 

B 

0 

8 

11 

1.30 

0.50 

2.26 

-0.17 

1MD314 

C 

0 

5 

7 

0.00 

0.25 

0.28 

-0.40 

1MD314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD315 

* 

-1 

1750 

92 

1.50 

0.03 

0.00 

-0.07 

1MD315 

A 

1 

125 

87 

1.95 

0.10 

1.08 

0.17 

1MD315 

B 

0 

11 

8 

1.07 

0.27 

1.03 

-0.20 

1MD315 

C 

0 

8 

6 

1.80 

0.44 

2.84 

-0.02 

1MD315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD316 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1MD316 

A 

1 

40 

52 

2.14 

0.17 

1.03 

0.40 

1MD316 

B 

0 

24 

31 

1.28 

0.24 

1.24 

-0.21 

1MD316 

C 

0 

13 

17 

0.88 

0.35 

0.97 

-0.28 

1MD316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD317 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1MD317 

A 

1 

35 

49 

2.35 

0.18 

0.93 

0.42 

1MD317 

B 

0 

25 

35 

1.47 

0.24 

1.44 

-0.23 

1MD317 

C 

0 

11 

15 

1.04 

0.26 

0.68 

-0.28 

1MD317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD318 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1MD318 

A 

1 

71 

89 

1.82 

0.13 

0.99 

0.40 

1MD318 

B 

0 

7 

9 

0.47 

0.31 

0.69 

-0.31 

1MD318 

C 

0 

2 

3 

-0.26 

0.16 

0.24 

-0.26 

1MD318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD319 

* 

-1 

1801 

95 

1.51 

0.03 

0.00 

-0.06 

1MD319 

A 

1 

48 

52 

2.31 

0.16 

1.07 

0.42 

1MD319 

B 

0 

37 

40 

1.52 

0.13 

1.01 

-0.26 

1MD319 

C 

0 

8 

9 

0.82 

0.26 

0.46 

-0.29 

1MD319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD32 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1MD32 

A 

1 

60 

86 

2.32 

0.14 

0.98 

0.32 

1MD32 

B 

0 

6 

9 

1.47 

0.38 

1.02 

-0.19 

1MD32 

C 

0 

4 

6 

1.03 

0.42 

0.61 

-0.25 

1MD32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD320 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

1MD320 

A 

1 

59 

84 

1.71 

0.15 

0.86 

0.46 

1MD320 

B 

0 

7 

10 

0.33 

0.36 

0.78 

-0.30 

1MD320 

C 

0 

4 

6 

-0.31 

0.50 

0.40 

-0.34 

1MD320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD321 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1MD321 

A 

1 

68 

93 

1.45 

0.13 

0.86 

0.47 

1MD321 

B 

0 

5 

7 

-0.77 

0.38 

0.29 

-0.47 

1MD321 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD322 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1MD322 

A 

1 

71 

99 

1.97 

0.13 

0.99 

0.17 

1MD322 

B 

0 

1 

1 

0.33 

0.00 

0.35 

-0.17 

1MD322 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD323 

* 

-1 

1741 

92 

1.51 

0.03 

0.00 

-0.04 

1MD323 

A 

1 

144 

94 

1.77 

0.10 

1.07 

0.17 

1MD323 

B 

0 

4 

3 

0.32 

0.29 

0.49 

-0.19 

1MD323 

C 

0 

5 

3 

1.35 

0.15 

1.25 

-0.06 

1MD323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD324 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1MD324 

A 

1 

71 

93 

1.83 

0.13 

0.95 

0.29 

1MD324 

B 

0 

3 

4 

0.64 

0.45 

0.62 

-0.21 

1MD324 

C 

0 

2 

3 

0.45 

0.50 

0.47 

-0.20 

1MD324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD325 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1MD325 

A 

1 

23 

32 

2.42 

0.20 

0.84 

0.50 

1MD325 

B 

0 

20 

27 

1.08 

0.25 

0.76 

-0.29 

1MD325 

C 

0 

30 

41 

1.31 

0.17 

0.94 

-0.21 

1MD325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD326 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.06 

1MD326 

A 

1 

68 

92 

2.02 

0.13 

0.90 

0.34 

1MD326 

B 

0 

4 

5 

1.10 

0.38 

0.89 

-0.17 

1MD326 

C 

0 

2 

3 

-0.39 

0.08 

0.16 

-0.34 

1MD326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD327 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1MD327 

A 

1 

67 

78 

1.75 

0.14 

0.90 

0.44 

1MD327 

B 

0 

15 

17 

0.39 

0.26 

0.81 

-0.42 

1MD327 

C 

0 

4 

5 

0.85 

0.21 

0.80 

-0.12 

1MD327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD328 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1MD328 

A 

1 

71 

88 

1.59 

0.12 

0.97 

0.31 

1MD328 

B 

0 

6 

7 

0.80 

0.41 

1.20 

-0.17 

1MD328 

C 

0 

4 

5 

0.24 

0.40 

0.55 

-0.26 

1MD328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1MD329 

* 

-1 

1823 

96 

1.52 

0.03 

0.00 

-0.03 

1MD329 

A 

1 

66 

93 

1.84 

0.11 

0.95 

0.30 

1MD329 

B 

0 

2 

3 

0.94 

0.25 

0.60 

-0.16 

1MD329 

C 

0 

3 

4 

0.69 

0.38 

0.52 

-0.25 

1MD329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD33 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1MD33 

A 

1 

57 

81 

2.13 

0.18 

1.11 

0.26 

1MD33 

B 

0 

4 

6 

1.33 

0.21 

0.99 

-0.11 

1MD33 

C 

0 

9 

13 

1.13 

0.50 

2.24 

-0.23 

1MD33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD410 

* 

-1 

1745 

92 

1.51 

0.03 

0.00 

-0.05 

1MD410 

A 

1 

116 

78 

1.92 

0.11 

1.10 

0.26 

1MD410 

B 

0 

20 

13 

1.19 

0.25 

1.23 

-0.20 

1MD410 

C 

0 

13 

9 

1.20 

0.23 

1.14 

-0.15 

1MD410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1MD421 

* 

-1 

1727 

91 

1.48 

0.03 

0.00 

-0.10 

1MD421 

A 

1 

62 

37 

2.74 

0.14 

0.91 

0.52 

1MD421 

B 

0 

81 

49 

1.43 

0.09 

0.69 

-0.50 

1MD421 

C 

0 

24 

14 

1.98 

0.22 

1.49 

0.00 

1MD421 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT21 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT21 

A 

1 

44 

57 

2.33 

0.15 

0.81 

0.63 

1NBT21 

B 

0 

14 

18 

0.72 

0.30 

0.68 

-0.36 

1NBT21 

C 

0 

19 

25 

0.80 

0.16 

0.57 

-0.40 

1NBT21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT22 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1NBT22 

A 

1 

53 

75 

2.17 

0.16 

1.00 

0.48 

1NBT22 

B 

0 

10 

14 

0.90 

0.26 

0.70 

-0.32 

1NBT22 

C 

0 

8 

11 

0.80 

0.21 

0.60 

-0.31 

1NBT22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT23 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT23 

A 

1 

55 

69 

2.04 

0.15 

0.91 

0.48 

1NBT23 

B 

0 

11 

14 

0.45 

0.28 

0.53 

-0.40 

1NBT23 

C 

0 

14 

18 

1.08 

0.26 

1.13 

-0.22 

1NBT23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT24 

* 

-1 

1801 

95 

1.51 

0.03 

0.00 

-0.06 

1NBT24 

A 

1 

78 

84 

2.09 

0.12 

0.90 

0.46 

1NBT24 

B 

0 

10 

11 

0.76 

0.19 

0.54 

-0.35 

1NBT24 

C 

0 

5 

5 

0.63 

0.17 

0.43 

-0.27 

1NBT24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT25 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1NBT25 

A 

1 

61 

87 

2.33 

0.14 

0.93 

0.36 

1NBT25 

B 

0 

7 

10 

1.21 

0.38 

0.90 

-0.28 

1NBT25 

C 

0 

2 

3 

0.73 

0.32 

0.37 

-0.22 

1NBT25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT31 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

1NBT31 

A 

1 

45 

64 

1.85 

0.18 

1.08 

0.41 

1NBT31 

B 

0 

13 

19 

0.62 

0.24 

0.79 

-0.31 

1NBT31 

C 

0 

12 

17 

0.89 

0.36 

1.34 

-0.20 

1NBT31 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT310 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1NBT310 

A 

1 

40 

55 

1.69 

0.19 

1.37 

0.36 

1NBT310 

B 

0 

10 

14 

0.51 

0.42 

0.97 

-0.27 

1NBT310 

C 

0 

23 

32 

0.97 

0.19 

1.08 

-0.19 

1NBT310 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT311 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT311 

A 

1 

45 

63 

2.42 

0.14 

0.84 

0.57 

1NBT311 

B 

0 

21 

29 

1.27 

0.19 

0.86 

-0.39 

1NBT311 

C 

0 

6 

8 

0.70 

0.30 

0.40 

-0.34 

1NBT311 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT312 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1NBT312 

A 

1 

61 

80 

1.94 

0.14 

0.94 

0.36 

1NBT312 

B 

0 

11 

14 

1.25 

0.20 

0.98 

-0.19 

1NBT312 

C 

0 

4 

5 

0.20 

0.20 

0.31 

-0.34 

1NBT312 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT313 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1NBT313 

A 

1 

60 

82 

1.83 

0.13 

0.89 

0.45 

1NBT313 

B 

0 

10 

14 

0.60 

0.36 

0.91 

-0.35 

1NBT313 

C 

0 

3 

4 

0.20 

0.51 

0.46 

-0.26 

1NBT313 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT314 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT314 

A 

1 

52 

70 

2.15 

0.17 

1.11 

0.33 

1NBT314 

B 

0 

17 

23 

1.38 

0.20 

1.01 

-0.25 

1NBT314 

C 

0 

5 

7 

1.19 

0.20 

0.69 

-0.17 

1NBT314 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT315 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1NBT315 

A 

1 

51 

59 

1.89 

0.17 

1.13 

0.42 

1NBT315 

B 

0 

18 

21 

1.10 

0.17 

0.99 

-0.16 

1NBT315 

C 

0 

17 

20 

0.61 

0.20 

0.65 

-0.36 

1NBT315 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT316 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1NBT316 

A 

1 

55 

68 

1.70 

0.15 

1.12 

0.33 

1NBT316 

B 

0 

13 

16 

0.87 

0.27 

1.04 

-0.24 

1NBT316 

C 

0 

13 

16 

1.04 

0.12 

0.88 

-0.17 

1NBT316 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT317 

* 

-1 

1823 

96 

1.52 

0.03 

0.00 

-0.03 

1NBT317 

A 

1 

48 

68 

1.91 

0.13 

1.05 

0.24 

1NBT317 

B 

0 

11 

15 

1.83 

0.25 

1.65 

0.03 

1NBT317 

C 

0 

12 

17 

1.12 

0.17 

0.70 

-0.33 

1NBT317 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT318 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT318 

A 

1 

43 

61 

2.48 

0.20 

1.15 

0.48 

1NBT318 

B 

0 

19 

27 

1.24 

0.24 

1.10 

-0.32 

1NBT318 

C 

0 

8 

11 

0.82 

0.25 

0.55 

-0.30 

1NBT318 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT319 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT319 

A 

1 

58 

75 

1.96 

0.16 

1.10 

0.43 

1NBT319 

B 

0 

10 

13 

1.01 

0.25 

0.90 

-0.21 

1NBT319 

C 

0 

9 

12 

0.44 

0.34 

0.58 

-0.36 

1NBT319 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT32 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1NBT32 

A 

1 

45 

63 

2.32 

0.16 

0.85 

0.53 

1NBT32 

B 

0 

17 

24 

1.19 

0.24 

1.04 

-0.30 

1NBT32 

C 

0 

9 

13 

0.64 

0.24 

0.45 

-0.38 

1NBT32 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT320 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT320 

A 

1 

54 

68 

1.76 

0.17 

1.54 

0.13 

1NBT320 

B 

0 

15 

19 

1.90 

0.27 

2.61 

0.10 

1NBT320 

C 

0 

11 

14 

0.78 

0.24 

0.69 

-0.29 

1NBT320 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT321 

* 

-1 

1802 

95 

1.51 

0.03 

0.00 

-0.05 

1NBT321 

A 

1 

63 

68 

2.18 

0.14 

0.96 

0.43 

1NBT321 

B 

0 

8 

9 

0.72 

0.20 

0.45 

-0.32 

1NBT321 

C 

0 

21 

23 

1.35 

0.17 

0.96 

-0.26 

1NBT321 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT322 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1NBT322 

A 

1 

64 

91 

2.28 

0.14 

0.96 

0.30 

1NBT322 

B 

0 

4 

6 

0.61 

0.32 

0.40 

-0.34 

1NBT322 

C 

0 

2 

3 

1.93 

0.20 

1.26 

-0.04 

1NBT322 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT323 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

1NBT323 

A 

1 

39 

56 

1.88 

0.20 

1.30 

0.38 

1NBT323 

B 

0 

14 

20 

0.68 

0.26 

0.80 

-0.31 

1NBT323 

C 

0 

17 

24 

1.12 

0.28 

1.57 

-0.15 

1NBT323 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT324 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1NBT324 

A 

1 

43 

59 

1.84 

0.16 

0.95 

0.54 

1NBT324 

B 

0 

12 

16 

0.56 

0.13 

0.59 

-0.28 

1NBT324 

C 

0 

18 

25 

0.52 

0.28 

0.87 

-0.37 

1NBT324 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT325 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT325 

A 

1 

52 

72 

2.26 

0.14 

0.93 

0.47 

1NBT325 

B 

0 

4 

6 

0.63 

0.43 

0.43 

-0.29 

1NBT325 

C 

0 

16 

22 

1.23 

0.22 

0.88 

-0.35 

1NBT325 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT326 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1NBT326 

A 

1 

68 

89 

1.88 

0.13 

0.94 

0.35 

1NBT326 

B 

0 

6 

8 

0.54 

0.23 

0.50 

-0.33 

1NBT326 

C 

0 

2 

3 

0.87 

0.09 

0.61 

-0.13 

1NBT326 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT327 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1NBT327 

A 

1 

47 

64 

1.92 

0.15 

1.01 

0.39 

1NBT327 

B 

0 

10 

14 

0.48 

0.27 

0.47 

-0.40 

1NBT327 

C 

0 

16 

22 

1.35 

0.29 

1.62 

-0.12 

1NBT327 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT328 

* 

-1 

1750 

92 

1.50 

0.03 

0.00 

-0.06 

1NBT328 

A 

1 

90 

63 

2.26 

0.13 

1.14 

0.46 

1NBT328 

B 

0 

35 

24 

1.21 

0.14 

0.93 

-0.27 

1NBT328 

C 

0 

19 

13 

0.80 

0.21 

0.60 

-0.32 

1NBT328 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS First Grade Math Measure Development 


359 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT329 

* 

-1 

1744 

92 

1.50 

0.03 

0.00 

-0.05 

1NBT329 

A 

1 

85 

57 

2.15 

0.13 

1.35 

0.38 

1NBT329 

B 

0 

40 

27 

1.58 

0.15 

1.36 

-0.10 

1NBT329 

C 

0 

25 

17 

0.78 

0.10 

0.47 

-0.39 

1NBT329 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT33 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT33 

A 

1 

62 

84 

2.16 

0.13 

0.81 

0.51 

1NBT33 

B 

0 

3 

4 

0.33 

0.42 

0.35 

-0.28 

1NBT33 

C 

0 

9 

12 

0.68 

0.20 

0.49 

-0.40 

1NBT33 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT330 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1NBT330 

A 

1 

60 

70 

1.77 

0.16 

1.19 

0.38 

1NBT330 

B 

0 

13 

15 

1.03 

0.21 

1.07 

-0.15 

1NBT330 

C 

0 

13 

15 

0.52 

0.19 

0.60 

-0.34 

1NBT330 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT331 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1NBT331 

A 

1 

61 

75 

1.64 

0.15 

1.15 

0.29 

1NBT331 

B 

0 

13 

16 

0.94 

0.19 

1.00 

-0.21 

1NBT331 

C 

0 

7 

9 

0.89 

0.27 

0.88 

-0.16 

1NBT331 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT332 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

1NBT332 

A 

1 

58 

83 

1.89 

0.12 

0.99 

0.27 

1NBT332 

B 

0 

5 

7 

1.28 

0.21 

0.83 

-0.16 

1NBT332 

C 

0 

7 

10 

1.25 

0.31 

0.95 

-0.20 

1NBT332 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT333 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT333 

A 

1 

53 

76 

2.32 

0.18 

1.04 

0.47 

1NBT333 

B 

0 

6 

9 

0.43 

0.20 

0.38 

-0.34 

1NBT333 

C 

0 

11 

16 

1.02 

0.25 

0.85 

-0.30 

1NBT333 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT334 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT334 

A 

1 

55 

71 

2.01 

0.16 

1.17 

0.45 

1NBT334 

B 

0 

19 

25 

0.88 

0.23 

0.87 

-0.37 

1NBT334 

C 

0 

3 

4 

0.17 

0.20 

0.31 

-0.24 

1NBT334 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT335 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1NBT335 

A 

1 

60 

85 

1.97 

0.16 

1.09 

0.25 

1NBT335 

B 

0 

7 

10 

0.75 

0.32 

0.68 

-0.30 

1NBT335 

C 

0 

4 

6 

1.80 

0.29 

1.68 

-0.01 

1NBT335 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT336 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT336 

A 

1 

51 

64 

1.97 

0.16 

1.09 

0.36 

1NBT336 

B 

0 

13 

16 

1.54 

0.32 

1.91 

-0.04 

1NBT336 

C 

0 

16 

20 

0.72 

0.23 

0.66 

-0.39 

1NBT336 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT337 

* 

-1 

1805 

95 

1.51 

0.03 

0.00 

-0.06 

1NBT337 

A 

1 

59 

66 

2.22 

0.14 

0.99 

0.42 

1NBT337 

B 

0 

13 

15 

0.96 

0.21 

0.62 

-0.36 

1NBT337 

C 

0 

17 

19 

1.49 

0.18 

1.04 

-0.18 

1NBT337 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT338 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1NBT338 

A 

1 

66 

94 

2.24 

0.14 

0.96 

0.26 

1NBT338 

B 

0 

1 

1 

0.88 

0.00 

0.45 

-0.14 

1NBT338 

C 

0 

3 

4 

1.02 

0.79 

0.98 

-0.22 

1NBT338 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT339 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

1NBT339 

A 

1 

34 

49 

1.60 

0.26 

2.29 

0.11 

1NBT339 

B 

0 

28 

40 

1.40 

0.19 

1.62 

-0.04 

1NBT339 

C 

0 

8 

11 

1.03 

0.37 

1.01 

-0.12 

1NBT339 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT34 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1NBT34 

A 

1 

43 

59 

1.68 

0.16 

1.04 

0.38 

1NBT34 

B 

0 

17 

23 

1.18 

0.26 

1.62 

-0.06 

1NBT34 

C 

0 

13 

18 

0.20 

0.30 

0.58 

-0.43 

1NBT34 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT340 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT340 

A 

1 

54 

75 

2.16 

0.14 

1.03 

0.35 

1NBT340 

B 

0 

12 

17 

1.34 

0.27 

1.03 

-0.25 

1NBT340 

C 

0 

6 

8 

1.20 

0.52 

1.28 

-0.21 

1NBT340 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT35 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1NBT35 

A 

1 

63 

83 

1.84 

0.14 

1.03 

0.18 

1NBT35 

B 

0 

9 

12 

1.65 

0.32 

1.79 

-0.03 

1NBT35 

C 

0 

4 

5 

0.54 

0.32 

0.49 

-0.26 

1NBT35 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT36 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1NBT36 

A 

1 

64 

88 

1.75 

0.13 

0.96 

0.36 

1NBT36 

B 

0 

6 

8 

0.70 

0.32 

0.82 

-0.24 

1NBT36 

C 

0 

3 

4 

0.13 

0.86 

0.58 

-0.27 

1NBT36 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT37 

* 

-1 

1675 

88 

1.49 

0.03 

0.00 

-0.07 

1NBT37 

A 

1 

133 

61 

2.24 

0.10 

1.07 

0.43 

1NBT37 

B 

0 

25 

11 

1.09 

0.26 

1.26 

-0.20 

1NBT37 

C 

0 

61 

28 

1.15 

0.14 

1.25 

-0.32 

1NBT37 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT38 

* 

-1 

1820 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT38 

A 

1 

46 

62 

2.23 

0.18 

1.08 

0.37 

1NBT38 

B 

0 

19 

26 

1.17 

0.18 

0.76 

-0.38 

1NBT38 

C 

0 

9 

12 

1.81 

0.21 

1.32 

-0.03 

1NBT38 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT39 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1NBT39 

A 

1 

58 

67 

1.75 

0.17 

1.27 

0.33 

1NBT39 

B 

0 

8 

9 

0.89 

0.27 

0.89 

-0.16 

1NBT39 

C 

0 

20 

23 

0.90 

0.19 

0.99 

-0.26 

1NBT39 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT51 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1NBT51 

A 

1 

70 

86 

1.53 

0.13 

1.02 

0.15 

1NBT51 

B 

0 

6 

7 

1.22 

0.46 

1.71 

-0.06 

1NBT51 

C 

0 

5 

6 

0.88 

0.62 

1.77 

-0.14 

1NBT51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT510 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

1NBT510 

A 

1 

58 

83 

1.88 

0.12 

0.98 

0.25 

1NBT510 

B 

0 

4 

6 

0.70 

0.30 

0.49 

-0.30 

1NBT510 

C 

0 

8 

11 

1.60 

0.30 

1.44 

-0.07 

1NBT510 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT511 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT511 

A 

1 

48 

69 

2.43 

0.19 

1.10 

0.51 

1NBT511 

B 

0 

11 

16 

0.81 

0.18 

0.54 

-0.36 

1NBT511 

C 

0 

11 

16 

1.03 

0.27 

0.80 

-0.29 

1NBT511 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT512 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT512 

A 

1 

63 

82 

1.87 

0.14 

0.93 

0.36 

1NBT512 

B 

0 

7 

9 

0.72 

0.49 

1.06 

-0.24 

1NBT512 

C 

0 

7 

9 

0.73 

0.59 

1.50 

-0.24 

1NBT512 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT513 

* 

-1 

1823 

96 

1.51 

0.03 

0.00 

-0.04 

1NBT513 

A 

1 

38 

54 

2.34 

0.20 

1.08 

0.45 

1NBT513 

B 

0 

17 

24 

0.97 

0.22 

0.66 

-0.40 

1NBT513 

C 

0 

16 

23 

1.55 

0.21 

1.10 

-0.13 

1NBT513 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT514 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT514 

A 

1 

60 

75 

1.96 

0.14 

0.95 

0.45 

1NBT514 

B 

0 

12 

15 

0.64 

0.25 

0.71 

-0.36 

1NBT514 

C 

0 

8 

10 

0.83 

0.39 

0.89 

-0.23 

1NBT514 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT515 

* 

-1 

1806 

95 

1.51 

0.03 

0.00 

-0.06 

1NBT515 

A 

1 

61 

69 

2.17 

0.14 

1.02 

0.36 

1NBT515 

B 

0 

18 

20 

1.57 

0.22 

1.40 

-0.16 

1NBT515 

C 

0 

9 

10 

0.81 

0.18 

0.48 

-0.34 

1NBT515 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT516 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1NBT516 

A 

1 

45 

64 

2.65 

0.16 

0.84 

0.57 

1NBT516 

B 

0 

10 

14 

1.32 

0.22 

0.61 

-0.31 

1NBT516 

C 

0 

15 

21 

1.30 

0.20 

0.66 

-0.40 

1NBT516 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT517 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

1NBT517 

A 

1 

52 

74 

1.73 

0.17 

1.03 

0.36 

1NBT517 

B 

0 

11 

16 

0.63 

0.42 

1.33 

-0.28 

1NBT517 

C 

0 

7 

10 

0.73 

0.13 

0.72 

-0.19 

1NBT517 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT518 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1NBT518 

A 

1 

48 

66 

1.54 

0.17 

1.16 

0.28 

1NBT518 

B 

0 

4 

5 

0.28 

0.79 

0.96 

-0.21 

1NBT518 

C 

0 

21 

29 

0.95 

0.24 

1.32 

-0.18 

1NBT518 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT519 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT519 

A 

1 

56 

78 

2.11 

0.13 

1.00 

0.28 

1NBT519 

B 

0 

8 

11 

1.67 

0.52 

2.66 

-0.09 

1NBT519 

C 

0 

8 

11 

1.08 

0.40 

0.97 

-0.28 

1NBT519 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT52 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1NBT52 

A 

1 

32 

42 

2.23 

0.22 

1.16 

0.38 

1NBT52 

B 

0 

27 

36 

1.42 

0.17 

1.21 

-0.22 

1NBT52 

C 

0 

17 

22 

1.37 

0.16 

0.83 

-0.19 

1NBT52 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT520 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1NBT520 

A 

1 

58 

79 

1.85 

0.13 

0.88 

0.45 

1NBT520 

B 

0 

15 

21 

0.60 

0.29 

0.88 

-0.45 

1NBT520 

C 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT520 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT521 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT521 

A 

1 

60 

82 

2.15 

0.14 

0.90 

0.45 

1NBT521 

B 

0 

3 

4 

1.06 

0.39 

0.71 

-0.15 

1NBT521 

C 

0 

10 

14 

0.74 

0.20 

0.53 

-0.41 

1NBT521 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT522 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1NBT522 

A 

1 

47 

55 

2.04 

0.16 

0.83 

0.52 

1NBT522 

B 

0 

8 

9 

0.45 

0.25 

0.51 

-0.28 

1NBT522 

C 

0 

31 

36 

0.87 

0.18 

1.22 

-0.38 

1NBT522 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT523 

* 

-1 

1717 

91 

1.50 

0.03 

0.00 

-0.05 

1NBT523 

A 

1 

133 

75 

1.97 

0.10 

1.06 

0.33 

1NBT523 

B 

0 

14 

8 

1.04 

0.24 

0.99 

-0.18 

1NBT523 

C 

0 

30 

17 

1.12 

0.17 

1.01 

-0.25 

1NBT523 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT524 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1NBT524 

A 

1 

61 

75 

1.76 

0.13 

0.92 

0.48 

1NBT524 

B 

0 

9 

11 

0.25 

0.22 

0.47 

-0.40 

1NBT524 

C 

0 

11 

14 

0.80 

0.14 

0.75 

-0.24 

1NBT524 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT525 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

1NBT525 

A 

1 

49 

70 

2.03 

0.12 

0.89 

0.43 

1NBT525 

B 

0 

3 

4 

0.70 

0.25 

0.42 

-0.26 

1NBT525 

C 

0 

18 

26 

1.28 

0.18 

1.07 

-0.33 

1NBT525 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT526 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT526 

A 

1 

50 

71 

2.34 

0.19 

1.02 

0.45 

1NBT526 

B 

0 

8 

11 

1.14 

0.34 

0.93 

-0.21 

1NBT526 

C 

0 

12 

17 

0.87 

0.28 

0.80 

-0.36 

1NBT526 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT527 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT527 

A 

1 

60 

78 

1.90 

0.15 

1.21 

0.37 

1NBT527 

B 

0 

8 

10 

0.94 

0.32 

0.99 

-0.20 

1NBT527 

C 

0 

9 

12 

0.69 

0.37 

0.86 

-0.29 

1NBT527 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT528 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

1NBT528 

A 

1 

43 

61 

2.18 

0.17 

1.05 

0.40 

1NBT528 

B 

0 

16 

23 

1.16 

0.24 

0.94 

-0.30 

1NBT528 

C 

0 

11 

16 

1.30 

0.36 

1.44 

-0.19 

1NBT528 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT529 

* 

-1 

1725 

91 

1.53 

0.03 

0.00 

0.01 

1NBT529 

A 

1 

128 

76 

1.67 

0.10 

1.04 

0.30 

1NBT529 

B 

0 

21 

12 

0.88 

0.19 

1.07 

-0.19 

1NBT529 

C 

0 

20 

12 

0.83 

0.23 

1.07 

-0.20 

1NBT529 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT53 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT53 

A 

1 

58 

73 

1.94 

0.15 

0.97 

0.40 

1NBT53 

B 

0 

9 

11 

0.80 

0.39 

0.89 

-0.25 

1NBT53 

C 

0 

13 

16 

0.94 

0.27 

0.93 

-0.26 

1NBT53 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT530 

* 

-1 

1806 

95 

1.51 

0.03 

0.00 

-0.06 

1NBT530 

A 

1 

61 

69 

2.17 

0.14 

1.00 

0.37 

1NBT530 

B 

0 

8 

9 

1.35 

0.32 

1.02 

-0.16 

1NBT530 

C 

0 

19 

22 

1.29 

0.21 

1.00 

-0.30 

1NBT530 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT531 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1NBT531 

A 

1 

56 

80 

2.29 

0.15 

1.11 

0.22 

1NBT531 

B 

0 

8 

11 

2.03 

0.37 

1.82 

-0.04 

1NBT531 

C 

0 

6 

9 

1.21 

0.27 

0.64 

-0.26 

1NBT531 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT532 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

1NBT532 

A 

1 

41 

59 

1.98 

0.20 

1.28 

0.49 

1NBT532 

B 

0 

26 

37 

0.77 

0.14 

0.78 

-0.42 

1NBT532 

C 

0 

3 

4 

0.24 

0.74 

0.57 

-0.20 

1NBT532 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT533 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1NBT533 

A 

1 

60 

82 

1.52 

0.15 

1.07 

0.39 

1NBT533 

B 

0 

5 

7 

-0.15 

0.64 

0.69 

-0.33 

1NBT533 

C 

0 

8 

11 

0.60 

0.28 

1.01 

-0.21 

1NBT533 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT534 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT534 

A 

1 

53 

74 

2.32 

0.13 

0.81 

0.57 

1NBT534 

B 

0 

9 

13 

0.62 

0.23 

0.42 

-0.46 

1NBT534 

C 

0 

10 

14 

1.17 

0.28 

0.82 

-0.29 

1NBT534 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT535 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1NBT535 

A 

1 

45 

59 

2.10 

0.17 

1.03 

0.39 

1NBT535 

B 

0 

9 

12 

1.06 

0.27 

0.77 

-0.23 

1NBT535 

C 

0 

22 

29 

1.32 

0.15 

0.95 

-0.25 

1NBT535 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT536 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1NBT536 

A 

1 

48 

66 

2.05 

0.14 

0.83 

0.56 

1NBT536 

B 

0 

12 

16 

0.67 

0.23 

0.62 

-0.37 

1NBT536 

C 

0 

13 

18 

0.77 

0.29 

0.80 

-0.34 

1NBT536 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT537 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT537 

A 

1 

48 

66 

2.24 

0.17 

1.02 

0.40 

1NBT537 

B 

0 

14 

19 

1.30 

0.27 

1.17 

-0.26 

1NBT537 

C 

0 

11 

15 

1.24 

0.21 

0.81 

-0.25 

1NBT537 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT538 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1NBT538 

A 

1 

54 

63 

1.81 

0.17 

1.29 

0.38 

1NBT538 

B 

0 

15 

17 

0.75 

0.21 

0.79 

-0.28 

1NBT538 

C 

0 

17 

20 

1.01 

0.19 

1.03 

-0.19 

1NBT538 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT539 

* 

-1 

1813 

96 

1.53 

0.03 

0.00 

0.01 

1NBT539 

A 

1 

58 

72 

1.62 

0.15 

1.20 

0.23 

1NBT539 

B 

0 

11 

14 

1.23 

0.32 

1.61 

-0.09 

1NBT539 

C 

0 

12 

15 

0.91 

0.15 

0.83 

-0.21 

1NBT539 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT54 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

1NBT54 

A 

1 

37 

53 

2.10 

0.16 

1.06 

0.38 

1NBT54 

B 

0 

10 

14 

1.65 

0.21 

1.12 

-0.06 

1NBT54 

C 

0 

23 

33 

1.32 

0.12 

0.80 

-0.36 

1NBT54 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT540 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT540 

A 

1 

41 

59 

2.54 

0.20 

1.01 

0.51 

1NBT540 

B 

0 

16 

23 

1.00 

0.24 

0.77 

-0.38 

1NBT540 

C 

0 

13 

19 

1.30 

0.33 

1.37 

-0.23 

1NBT540 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT55 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT55 

A 

1 

63 

82 

1.96 

0.13 

0.79 

0.52 

1NBT55 

B 

0 

7 

9 

0.65 

0.50 

1.23 

-0.26 

1NBT55 

C 

0 

7 

9 

-0.06 

0.38 

0.46 

-0.44 

1NBT55 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



easyCBM CCSS First Grade Math Measure Development 


370 

Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT56 

* 

-1 

1748 

92 

1.52 

0.03 

0.00 

-0.02 

1NBT56 

A 

1 

135 

92 

1.73 

0.09 

0.89 

0.33 

1NBT56 

B 

0 

6 

4 

0.42 

0.58 

1.10 

-0.21 

1NBT56 

C 

0 

5 

3 

0.02 

0.70 

0.81 

-0.25 

1NBT56 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT57 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

1NBT57 

A 

1 

43 

61 

2.16 

0.19 

1.28 

0.37 

1NBT57 

B 

0 

11 

16 

1.17 

0.33 

1.15 

-0.24 

1NBT57 

C 

0 

16 

23 

1.32 

0.20 

1.02 

-0.23 

1NBT57 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT58 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

1NBT58 

A 

1 

65 

81 

1.95 

0.13 

0.82 

0.52 

1NBT58 

B 

0 

8 

10 

0.37 

0.23 

0.48 

-0.36 

1NBT58 

C 

0 

7 

9 

0.34 

0.41 

0.62 

-0.34 

1NBT58 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT59 

* 

-1 

1806 

95 

1.51 

0.03 

0.00 

-0.06 

1NBT59 

A 

1 

49 

56 

2.38 

0.15 

0.86 

0.49 

1NBT59 

B 

0 

31 

35 

1.33 

0.15 

0.88 

-0.39 

1NBT59 

C 

0 

8 

9 

1.23 

0.38 

0.95 

-0.20 

1NBT59 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT61 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

1NBT61 

A 

1 

49 

70 

2.50 

0.16 

1.03 

0.45 

1NBT61 

B 

0 

7 

10 

1.02 

0.26 

0.48 

-0.34 

1NBT61 

C 

0 

14 

20 

1.60 

0.17 

0.85 

-0.25 

1NBT61 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT610 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

1NBT610 

A 

1 

31 

44 

2.11 

0.24 

1.27 

0.46 

1NBT610 

B 

0 

16 

23 

1.11 

0.19 

0.96 

-0.15 

1NBT610 

C 

0 

23 

33 

0.82 

0.23 

0.95 

-0.35 

1NBT610 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT611 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

1NBT611 

A 

1 

45 

62 

1.77 

0.15 

0.85 

0.49 

1NBT611 

B 

0 

7 

10 

0.72 

0.23 

0.76 

-0.16 

1NBT611 

C 

0 

21 

29 

0.50 

0.27 

0.95 

-0.43 

1NBT611 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT612 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT612 

A 

1 

50 

69 

2.17 

0.15 

1.17 

0.31 

1NBT612 

B 

0 

13 

18 

1.65 

0.33 

1.64 

-0.13 

1NBT612 

C 

0 

9 

13 

1.13 

0.24 

0.68 

-0.28 

1NBT612 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT613 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1NBT613 

A 

1 

56 

74 

1.95 

0.15 

1.05 

0.30 

1NBT613 

B 

0 

5 

7 

1.05 

0.21 

0.70 

-0.17 

1NBT613 

C 

0 

15 

20 

1.25 

0.21 

1.06 

-0.23 

1NBT613 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT614 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

1NBT614 

A 

1 

49 

67 

1.95 

0.14 

0.95 

0.45 

1NBT614 

B 

0 

16 

22 

1.12 

0.26 

1.19 

-0.22 

1NBT614 

C 

0 

8 

11 

0.36 

0.34 

0.48 

-0.39 

1NBT614 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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Appendix E: Distractor Statistics 


ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT615 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT615 

A 

1 

59 

81 

2.19 

0.14 

0.83 

0.49 

1NBT615 

B 

0 

10 

14 

0.48 

0.20 

0.40 

-0.50 

1NBT615 

C 

0 

4 

5 

1.45 

0.05 

0.91 

-0.10 

1NBT615 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT616 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

1NBT616 

A 

1 

57 

66 

1.90 

0.14 

0.83 

0.51 

1NBT616 

B 

0 

14 

16 

0.94 

0.26 

1.08 

-0.19 

1NBT616 

C 

0 

15 

17 

0.31 

0.20 

0.53 

-0.45 

1NBT616 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT617 

* 

-1 

1814 

96 

1.53 

0.03 

0.00 

0.01 

1NBT617 

A 

1 

48 

60 

1.75 

0.17 

1.21 

0.33 

1NBT617 

B 

0 

16 

20 

1.17 

0.19 

1.11 

-0.14 

1NBT617 

C 

0 

16 

20 

0.88 

0.19 

0.94 

-0.27 

1NBT617 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT618 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

1NBT618 

A 

1 

30 

43 

2.25 

0.17 

0.95 

0.45 

1NBT618 

B 

0 

11 

16 

1.62 

0.21 

1.04 

-0.08 

1NBT618 

C 

0 

29 

41 

1.37 

0.13 

0.83 

-0.39 

1NBT618 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT619 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

1NBT619 

A 

1 

50 

71 

2.40 

0.19 

0.99 

0.51 

1NBT619 

B 

0 

10 

14 

0.73 

0.28 

0.64 

-0.36 

1NBT619 

C 

0 

10 

14 

0.96 

0.24 

0.71 

-0.30 

1NBT619 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1NBT631 

* 

-1 

1750 

92 

1.50 

0.03 

0.00 

-0.07 

1NBT631 

A 

1 

74 

51 

2.38 

0.14 

1.07 

0.44 

1NBT631 

B 

0 

33 

23 

1.16 

0.17 

0.86 

-0.33 

1NBT631 

C 

0 

37 

26 

1.50 

0.14 

1.11 

-0.19 

1NBT631 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT639 

* 

-1 

1745 

92 

1.51 

0.03 

0.00 

-0.03 

1NBT639 

A 

1 

89 

60 

2.02 

0.12 

1.06 

0.38 

1NBT639 

B 

0 

25 

17 

1.18 

0.21 

1.13 

-0.20 

1NBT639 

C 

0 

35 

23 

1.15 

0.15 

0.98 

-0.26 

1NBT639 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1NBT65 

* 

-1 

1717 

91 

1.50 

0.03 

0.00 

-0.05 

1NBT65 

A 

1 

141 

80 

2.00 

0.09 

0.90 

0.43 

1NBT65 

B 

0 

20 

11 

0.73 

0.21 

0.75 

-0.32 

1NBT65 

C 

0 

16 

9 

0.84 

0.21 

0.77 

-0.25 

1NBT65 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A21 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

10A21 

A 

1 

57 

74 

2.02 

0.14 

0.88 

0.49 

10A21 

B 

0 

16 

21 

0.72 

0.31 

1.03 

-0.39 

10A21 

C 

0 

4 

5 

0.28 

0.30 

0.38 

-0.26 

10A21 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1OA210 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

1OA210 

A 

1 

49 

70 

2.07 

0.18 

1.22 

0.35 

1OA210 

B 

0 

11 

16 

1.29 

0.28 

1.06 

-0.19 

1OA210 

C 

0 

10 

14 

1.08 

0.16 

0.70 

-0.25 

1OA210 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A211 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

10A211 

A 

1 

60 

75 

1.95 

0.14 

0.96 

0.43 

10A211 

B 

0 

13 

16 

0.44 

0.26 

0.58 

-0.45 

10A211 

C 

0 

7 

9 

1.34 

0.32 

1.47 

-0.08 

10A211 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A212 

* 

-1 

1806 

95 

1.51 

0.03 

0.00 

-0.06 

10A212 

A 

1 

78 

89 

2.04 

0.12 

0.96 

0.34 

10A212 

B 

0 

6 

7 

0.80 

0.22 

0.55 

-0.28 

10A212 

C 

0 

4 

5 

0.97 

0.46 

0.80 

-0.19 

10A212 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A213 

* 

-1 

1733 

91 

1.51 

0.03 

0.00 

-0.03 

10A213 

A 

1 

132 

82 

1.87 

0.10 

1.07 

0.34 

10A213 

B 

0 

20 

12 

0.96 

0.21 

1.15 

-0.23 

10A213 

C 

0 

9 

6 

0.48 

0.19 

0.51 

-0.25 

10A213 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A214 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

10A214 

A 

1 

47 

67 

2.59 

0.16 

1.00 

0.53 

10A214 

B 

0 

17 

24 

1.22 

0.14 

0.56 

-0.48 

10A214 

C 

0 

6 

9 

1.63 

0.17 

0.76 

-0.15 

10A214 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A215 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

10A215 

A 

1 

51 

73 

1.88 

0.16 

0.82 

0.55 

10A215 

B 

0 

13 

19 

0.31 

0.28 

0.69 

-0.43 

10A215 

C 

0 

6 

9 

0.34 

0.25 

0.53 

-0.27 

10A215 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A216 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

10A216 

A 

1 

56 

77 

1.55 

0.15 

1.01 

0.38 

10A216 

B 

0 

14 

19 

0.69 

0.27 

1.10 

-0.25 

10A216 

C 

0 

3 

4 

-0.55 

0.80 

0.40 

-0.32 

10A216 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A217 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

10A217 

A 

1 

52 

72 

2.31 

0.14 

0.88 

0.54 

10A217 

B 

0 

9 

13 

0.67 

0.25 

0.46 

-0.44 

10A217 

C 

0 

11 

15 

1.27 

0.23 

0.80 

-0.26 

10A217 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A218 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

10A218 

A 

1 

61 

80 

1.97 

0.14 

0.90 

0.41 

10A218 

B 

0 

6 

8 

1.10 

0.21 

0.79 

-0.17 

10A218 

C 

0 

9 

12 

0.66 

0.27 

0.69 

-0.37 

10A218 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A219 

* 

-1 

1746 

92 

1.51 

0.03 

0.00 

-0.05 

10A219 

A 

1 

125 

84 

1.99 

0.10 

0.91 

0.47 

10A219 

B 

0 

16 

11 

0.21 

0.19 

0.45 

-0.44 

10A219 

C 

0 

7 

5 

0.84 

0.37 

0.89 

-0.17 

10A219 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A22 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

10A22 

A 

1 

43 

59 

1.86 

0.17 

1.28 

0.29 

10A22 

B 

0 

8 

11 

0.78 

0.42 

0.75 

-0.26 

10A22 

C 

0 

22 

30 

1.37 

0.22 

1.43 

-0.13 

10A22 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1OA220 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

1OA220 

A 

1 

56 

77 

2.24 

0.14 

0.82 

0.52 

1OA220 

B 

0 

10 

14 

0.99 

0.22 

0.67 

-0.32 

1OA220 

C 

0 

7 

10 

0.61 

0.24 

0.43 

-0.37 

1OA220 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A221 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

10A221 

A 

1 

60 

70 

1.82 

0.15 

0.93 

0.44 

10A221 

B 

0 

16 

19 

0.81 

0.24 

1.08 

-0.27 

10A221 

C 

0 

10 

12 

0.45 

0.27 

0.60 

-0.31 

10A221 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A222 

* 

-1 

1749 

92 

1.54 

0.03 

0.00 

0.03 

10A222 

A 

1 

108 

74 

1.71 

0.11 

0.99 

0.47 

10A222 

B 

0 

25 

17 

0.33 

0.19 

0.74 

-0.38 

10A222 

C 

0 

12 

8 

0.47 

0.30 

0.88 

-0.22 

10A222 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A223 

* 

-1 

1814 

96 

1.53 

0.03 

0.00 

0.01 

10A223 

A 

1 

53 

66 

1.85 

0.14 

0.87 

0.50 

10A223 

B 

0 

15 

19 

0.43 

0.20 

0.56 

-0.46 

10A223 

C 

0 

12 

15 

1.05 

0.16 

0.95 

-0.16 

10A223 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A224 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

10A224 

A 

1 

48 

69 

2.06 

0.13 

0.91 

0.46 

10A224 

B 

0 

11 

16 

1.22 

0.21 

0.81 

-0.27 

10A224 

C 

0 

11 

16 

1.13 

0.14 

0.66 

-0.32 

10A224 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A225 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

10A225 

A 

1 

49 

70 

2.45 

0.18 

0.90 

0.55 

10A225 

B 

0 

5 

7 

1.28 

0.33 

0.89 

-0.14 

10A225 

C 

0 

16 

23 

0.66 

0.22 

0.60 

-0.51 

10A225 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A23 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

10A23 

A 

1 

62 

81 

2.03 

0.13 

0.73 

0.61 

10A23 

B 

0 

8 

10 

0.44 

0.29 

0.60 

-0.34 

10A23 

C 

0 

7 

9 

-0.22 

0.33 

0.31 

-0.48 

10A23 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A24 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

10A24 

A 

1 

48 

69 

2.10 

0.17 

1.17 

0.37 

10A24 

B 

0 

9 

13 

0.93 

0.17 

0.60 

-0.29 

10A24 

C 

0 

13 

19 

1.33 

0.29 

1.29 

-0.19 

10A24 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A25 

* 

-1 

1814 

96 

1.52 

0.03 

0.00 

-0.02 

10A25 

A 

1 

63 

79 

1.91 

0.14 

0.90 

0.42 

10A25 

B 

0 

7 

9 

0.95 

0.41 

1.09 

-0.18 

10A25 

C 

0 

10 

13 

0.49 

0.34 

0.71 

-0.37 

10A25 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A26 

* 

-1 

1807 

95 

1.51 

0.03 

0.00 

-0.06 

10A26 

A 

1 

73 

84 

2.14 

0.12 

0.90 

0.44 

10A26 

B 

0 

7 

8 

1.00 

0.22 

0.65 

-0.26 

10A26 

C 

0 

7 

8 

0.73 

0.27 

0.55 

-0.33 

10A26 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A27 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

10A27 

A 

1 

50 

71 

2.50 

0.16 

1.02 

0.46 

10A27 

B 

0 

11 

16 

1.23 

0.20 

0.63 

-0.36 

10A27 

C 

0 

9 

13 

1.51 

0.22 

0.76 

-0.23 

10A27 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A28 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

10A28 

A 

1 

47 

67 

2.04 

0.15 

0.68 

0.65 

10A28 

B 

0 

15 

21 

0.60 

0.14 

0.64 

-0.35 

10A28 

C 

0 

8 

11 

-0.35 

0.28 

0.28 

-0.51 

10A28 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A29 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

10A29 

A 

1 

54 

74 

1.54 

0.16 

1.12 

0.34 

10A29 

B 

0 

11 

15 

0.81 

0.23 

1.04 

-0.17 

10A29 

C 

0 

8 

11 

0.34 

0.51 

0.97 

-0.28 

10A29 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A41 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

10A41 

A 

1 

54 

75 

2.30 

0.13 

0.89 

0.56 

10A41 

B 

0 

14 

19 

0.90 

0.18 

0.55 

-0.47 

10A41 

C 

0 

4 

6 

0.80 

0.35 

0.51 

-0.25 

10A41 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

1OA410 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

1OA410 

A 

1 

56 

74 

2.03 

0.15 

0.94 

0.44 

1OA410 

B 

0 

9 

12 

1.00 

0.24 

0.76 

-0.25 

1OA410 

C 

0 

11 

14 

0.92 

0.17 

0.66 

-0.31 

1OA410 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A411 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

10A411 

A 

1 

57 

78 

1.95 

0.13 

0.82 

0.59 

10A411 

B 

0 

7 

10 

0.37 

0.35 

0.50 

-0.36 

10A411 

C 

0 

9 

12 

0.34 

0.21 

0.45 

-0.42 

10A411 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A412 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

10A412 

A 

1 

64 

88 

2.10 

0.14 

0.87 

0.43 

10A412 

B 

0 

4 

5 

0.65 

0.38 

0.51 

-0.26 

10A412 

C 

0 

5 

7 

0.57 

0.30 

0.47 

-0.32 

10A412 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A413 

* 

-1 

1748 

92 

1.52 

0.03 

0.00 

-0.02 

10A413 

A 

1 

118 

81 

1.87 

0.10 

1.16 

0.44 

10A413 

B 

0 

12 

8 

0.31 

0.21 

0.50 

-0.33 

10A413 

C 

0 

16 

11 

0.70 

0.20 

0.81 

-0.27 

10A413 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A414 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

10A414 

A 

1 

62 

72 

1.84 

0.14 

0.85 

0.49 

10A414 

B 

0 

8 

9 

0.47 

0.45 

0.92 

-0.27 

10A414 

C 

0 

16 

19 

0.55 

0.18 

0.71 

-0.37 

10A414 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A415 

* 

-1 

1814 

96 

1.53 

0.03 

0.00 

0.01 

10A415 

A 

1 

67 

84 

1.64 

0.13 

1.00 

0.38 

10A415 

B 

0 

6 

8 

0.45 

0.26 

0.61 

-0.27 

10A415 

C 

0 

7 

9 

0.61 

0.21 

0.69 

-0.24 

10A415 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A416 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

10A416 

A 

1 

49 

70 

1.92 

0.13 

1.09 

0.23 

10A416 

B 

0 

5 

7 

1.28 

0.33 

0.91 

-0.16 

10A416 

C 

0 

16 

23 

1.53 

0.18 

1.20 

-0.15 

10A416 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A417 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.06 

10A417 

A 

1 

59 

84 

2.26 

0.16 

0.84 

0.51 

10A417 

B 

0 

4 

6 

0.00 

0.36 

0.32 

-0.35 

10A417 

C 

0 

7 

10 

0.53 

0.23 

0.51 

-0.35 

10A417 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A418 

* 

-1 

1817 

96 

1.52 

0.03 

0.00 

-0.02 

10A418 

A 

1 

59 

77 

2.00 

0.15 

1.05 

0.50 

10A418 

B 

0 

8 

10 

0.59 

0.29 

0.62 

-0.30 

10A418 

C 

0 

10 

13 

0.50 

0.30 

0.65 

-0.37 

10A418 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A419 

* 

-1 

1824 

96 

1.51 

0.03 

0.00 

-0.04 

10A419 

A 

1 

59 

84 

2.00 

0.15 

0.94 

0.38 

10A419 

B 

0 

8 

11 

0.82 

0.29 

0.74 

-0.30 

10A419 

C 

0 

3 

4 

0.60 

0.76 

0.76 

-0.22 

10A419 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A42 

* 

-1 

1816 

96 

1.52 

0.03 

0.00 

-0.02 

10A42 

A 

1 

28 

36 

2.23 

0.25 

1.37 

0.36 

10A42 

B 

0 

28 

36 

1.21 

0.16 

0.80 

-0.27 

10A42 

C 

0 

22 

28 

1.45 

0.25 

1.30 

-0.10 

10A42 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

1OA420 

* 

-1 

1807 

95 

1.51 

0.03 

0.00 

-0.06 

1OA420 

A 

1 

58 

67 

2.23 

0.15 

1.06 

0.40 

1OA420 

B 

0 

16 

18 

1.19 

0.17 

0.71 

-0.33 

1OA420 

C 

0 

13 

15 

1.48 

0.16 

0.90 

-0.17 

1OA420 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A421 

* 

-1 

1824 

96 

1.50 

0.03 

0.00 

-0.09 

10A421 

A 

1 

62 

89 

2.28 

0.14 

1.01 

0.27 

10A421 

B 

0 

5 

7 

1.70 

0.33 

1.13 

-0.11 

10A421 

C 

0 

3 

4 

0.73 

0.38 

0.41 

-0.27 

10A421 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A422 

* 

-1 

1824 

96 

1.53 

0.03 

0.00 

0.01 

10A422 

A 

1 

49 

70 

1.78 

0.17 

0.98 

0.39 

10A422 

B 

0 

10 

14 

0.97 

0.30 

1.20 

-0.16 

10A422 

C 

0 

11 

16 

0.45 

0.37 

0.94 

-0.34 

10A422 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A423 

* 

-1 

1741 

92 

1.51 

0.03 

0.00 

-0.04 

10A423 

A 

1 

111 

73 

2.06 

0.11 

0.92 

0.46 

10A423 

B 

0 

24 

16 

1.03 

0.20 

1.01 

-0.25 

10A423 

C 

0 

18 

12 

0.56 

0.20 

0.57 

-0.35 

10A423 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A424 

* 

-1 

1821 

96 

1.53 

0.03 

0.00 

0.03 

10A424 

A 

1 

54 

74 

1.68 

0.13 

0.76 

0.54 

10A424 

B 

0 

7 

10 

0.20 

0.54 

1.06 

-0.30 

10A424 

C 

0 

12 

16 

0.23 

0.29 

0.68 

-0.40 

10A424 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A425 

* 

-1 

1726 

91 

1.53 

0.03 

0.00 

0.01 

10A425 

A 

1 

134 

80 

1.73 

0.09 

0.89 

0.43 

10A425 

B 

0 

24 

14 

0.48 

0.20 

0.79 

-0.35 

10A425 

C 

0 

10 

6 

0.56 

0.18 

0.65 

-0.20 

10A425 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A43 

* 

-1 

1822 

96 

1.51 

0.03 

0.00 

-0.06 

10A43 

A 

1 

37 

51 

2.35 

0.16 

1.01 

0.38 

10A43 

B 

0 

14 

19 

1.65 

0.35 

1.57 

-0.13 

10A43 

C 

0 

21 

29 

1.42 

0.21 

0.92 

-0.31 

10A43 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A44 

* 

-1 

1818 

96 

1.52 

0.03 

0.00 

-0.03 

10A44 

A 

1 

36 

47 

2.04 

0.22 

1.36 

0.25 

10A44 

B 

0 

18 

24 

1.37 

0.17 

0.92 

-0.19 

10A44 

C 

0 

22 

29 

1.58 

0.18 

1.22 

-0.10 

10A44 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A45 

* 

-1 

1821 

96 

1.52 

0.03 

0.00 

-0.01 

10A45 

A 

1 

58 

79 

1.81 

0.14 

1.02 

0.38 

10A45 

B 

0 

7 

10 

0.85 

0.12 

0.68 

-0.22 

10A45 

C 

0 

8 

11 

0.68 

0.45 

0.92 

-0.29 

10A45 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A46 

* 

-1 

1821 

96 

1.51 

0.03 

0.00 

-0.06 

10A46 

A 

1 

36 

49 

2.03 

0.23 

1.76 

0.10 

10A46 

B 

0 

10 

14 

2.12 

0.41 

2.71 

0.07 

10A46 

C 

0 

27 

37 

1.68 

0.12 

1.06 

-0.16 

10A46 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A47 

* 

-1 

1808 

95 

1.53 

0.03 

0.00 

0.01 

10A47 

A 

1 

61 

71 

1.85 

0.14 

0.83 

0.49 

10A47 

B 

0 

14 

16 

0.61 

0.31 

1.18 

-0.32 

10A47 

C 

0 

11 

13 

0.48 

0.23 

0.64 

-0.32 

10A47 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A48 

* 

-1 

1814 

96 

1.53 

0.03 

0.00 

0.01 

10A48 

A 

1 

67 

84 

1.68 

0.12 

0.85 

0.46 

10A48 

B 

0 

5 

6 

0.14 

0.34 

0.49 

-0.31 

10A48 

C 

0 

8 

10 

0.46 

0.29 

0.69 

-0.31 

10A48 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A49 

* 

-1 

1824 

96 

1.52 

0.03 

0.00 

-0.04 

10A49 

A 

1 

52 

74 

1.94 

0.13 

1.00 

0.31 

10A49 

B 

0 

5 

7 

1.04 

0.24 

0.65 

-0.23 

10A49 

C 

0 

13 

19 

1.43 

0.21 

1.14 

-0.19 

10A49 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A51 

* 

-1 

1825 

96 

1.51 

0.03 

0.00 

-0.06 

10A51 

A 

1 

52 

75 

2.34 

0.17 

0.84 

0.49 

10A51 

B 

0 

5 

7 

0.61 

0.65 

1.18 

-0.27 

10A51 

C 

0 

12 

17 

0.82 

0.28 

0.80 

-0.37 

10A51 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A719 

* 

-1 

1745 

92 

1.51 

0.03 

0.00 

-0.03 

10A719 

A 

1 

124 

83 

1.88 

0.09 

0.91 

0.40 

10A719 

B 

0 

10 

7 

0.86 

0.27 

0.99 

-0.20 

10A719 

C 

0 

15 

10 

0.56 

0.29 

0.90 

-0.34 

10A719 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 
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ItemID 

Response 

Score 

n 

n % 

Avg. Prsn Msr 

SE 

OUT.MSQ 

PTME 

10A811 

* 

-1 

1739 

92 

1.51 

0.03 

0.00 

-0.03 

10A811 

A 

1 

120 

77 

1.79 

0.09 

1.01 

0.25 

10A811 

B 

0 

25 

16 

1.05 

0.15 

0.94 

-0.25 

10A811 

C 

0 

10 

6 

1.41 

0.52 

3.37 

-0.06 

10A811 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 

10A812 

* 

-1 

1727 

91 

1.48 

0.03 

0.00 

-0.10 

10A812 

A 

1 

58 

35 

2.17 

0.16 

1.83 

0.12 

10A812 

B 

0 

95 

57 

1.96 

0.10 

1.52 

-0.04 

10A812 

C 

0 

14 

8 

1.52 

0.29 

0.95 

-0.13 

10A812 

D 

0 

0 

0 

0.00 

0.00 

0.00 

0.00 



